-- Logs begin at Sun 2021-11-21 13:14:01 UTC, end at Sun 2021-11-21 14:13:20 UTC. -- Nov 21 13:43:36.334800 dv-cinder-768458-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 21 13:43:36.342747 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 21 13:43:36.345978 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Nov 21 13:43:36 2021] *** Nov 21 13:43:36.345978 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 21 13:43:36.345978 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 21 13:43:36.345978 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: nodename: dv-cinder-768458-12-iscsi Nov 21 13:43:36.345978 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: machine: x86_64 Nov 21 13:43:36.345978 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: clock source: unix Nov 21 13:43:36.345978 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: pcre jit disabled Nov 21 13:43:36.345978 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: detected number of CPU cores: 4 Nov 21 13:43:36.345978 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: current working directory: / Nov 21 13:43:36.345978 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: detected binary path: /usr/bin/uwsgi-core Nov 21 13:43:36.345978 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: your processes number limit is 47680 Nov 21 13:43:36.346676 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: your memory page size is 4096 bytes Nov 21 13:43:36.346676 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: detected max file descriptor number: 2048 Nov 21 13:43:36.346676 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: lock engine: pthread robust mutexes Nov 21 13:43:36.346676 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: thunder lock: enabled Nov 21 13:43:36.346676 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 21 13:43:36.346676 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 21 13:43:36.390868 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: Python main interpreter initialized at 0x558ff065e9c0 Nov 21 13:43:36.390868 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: python threads support enabled Nov 21 13:43:36.390868 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: your server socket listen backlog is limited to 100 connections Nov 21 13:43:36.390868 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: your mercy for graceful operations on workers is 90 seconds Nov 21 13:43:36.391210 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: mapped 403077 bytes (393 KB) for 2 cores Nov 21 13:43:36.391287 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: *** Operational MODE: preforking *** Nov 21 13:43:36.391553 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: *** uWSGI is running in multiple interpreter mode *** Nov 21 13:43:36.391553 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: spawned uWSGI master process (pid: 108345) Nov 21 13:43:36.391757 dv-cinder-768458-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 21 13:43:36.395270 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: spawned uWSGI worker 1 (pid: 108346, cores: 1) Nov 21 13:43:36.395270 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: spawned uWSGI worker 2 (pid: 108347, cores: 1) Nov 21 13:43:36.395270 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 21 13:43:37.990619 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 21 13:43:37.990619 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: from cryptography.utils import int_from_bytes Nov 21 13:43:37.991302 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 21 13:43:37.991302 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: from cryptography.utils import int_from_bytes Nov 21 13:43:37.991302 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 21 13:43:37.991302 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: from cryptography.utils import int_from_bytes Nov 21 13:43:37.991965 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 21 13:43:37.991965 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: from cryptography.utils import int_from_bytes Nov 21 13:43:40.471083 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 21 13:43:40.471761 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 21 13:43:40.471869 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 21 13:43:40.472228 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 21 13:43:40.472320 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 21 13:43:40.472399 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 21 13:43:40.472489 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 21 13:43:40.472567 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 21 13:43:40.472795 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.472931 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 21 13:43:40.473075 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 21 13:43:40.473167 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.473418 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.473511 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.473731 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.473828 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.474056 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.474157 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.474363 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.474453 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.474676 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.474761 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.474988 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.475074 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.475310 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.475395 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.475567 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.475652 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.475906 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.476016 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.476218 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.476303 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-12-iscsi {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.476535 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.476627 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.476843 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.476929 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-12-iscsi {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.477164 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.477251 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.477461 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.477557 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.477760 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.477851 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.478077 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.478169 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.478374 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.478466 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.478706 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.478879 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.479003 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.479325 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.479507 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.479671 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.479840 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.480000 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.480143 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.480296 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.480484 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.480602 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.480780 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.480907 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.481096 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.481222 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.481408 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.481513 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.481760 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.481870 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.482068 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.482233 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.482394 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.482530 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-12-iscsi {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.482707 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.482829 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.483112 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-12-iscsi {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.483260 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.483437 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.483538 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.483752 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.483903 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.484103 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.484202 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.484457 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.484557 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.484773 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.484859 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.485090 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.485192 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.485399 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.485510 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.485720 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.485813 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.486036 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.486134 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.486358 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.486448 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.486672 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.486756 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.486968 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.487053 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.487272 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.487362 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.487575 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.487666 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.487910 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.488000 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.488212 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.488303 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.488512 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.488607 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.488760 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.488847 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.489063 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.489148 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.489353 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.489445 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.489661 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.489753 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.489985 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.490083 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.490235 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.490333 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.490483 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.490613 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.490796 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.490888 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.491106 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.491193 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.491409 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.491492 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.491714 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.491795 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.492043 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.492145 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.492348 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.492433 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.492652 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.492755 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.492952 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.493062 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.493257 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.493366 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.493559 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.493661 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.493863 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.493949 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.494171 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.494256 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.494486 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.494581 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.494789 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.494881 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.495105 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.495192 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.495411 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.495504 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.11 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.495731 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.11 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.495852 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.496062 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.496147 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.11 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.496388 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.11 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.496475 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.496699 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.496790 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.497004 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.497094 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.497367 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.497453 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.497677 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.497761 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.497998 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.498082 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.498307 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.498399 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.498612 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.498696 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.498920 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.499006 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.499228 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.499314 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.499539 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.499624 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.499789 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.499941 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.500107 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.500200 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.500431 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.500735 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.500829 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.501044 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.501130 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.501349 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.501433 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.501659 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.501750 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.501966 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.502072 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.502263 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.502355 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.502564 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.502654 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.502867 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.502960 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.503171 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.503257 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.503478 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.503576 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.503781 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.503879 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.504108 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.504194 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.504410 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.504510 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.504711 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.504797 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.505677 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.505677 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.505677 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.505912 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.506153 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.506298 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.506439 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.506598 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.506753 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.506904 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.507065 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.507210 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.507347 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.507485 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.507620 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.507864 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.507952 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.508030 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.508116 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.508292 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.508420 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.508592 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.508731 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.508905 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.509293 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.509467 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.509616 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.509772 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.509925 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.510086 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.510232 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.510383 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.510552 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.510686 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.510862 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.510997 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.511170 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.511299 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.511490 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.511584 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.511794 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.511924 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.512128 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.512233 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.512445 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.512541 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.512753 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.513347 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.513580 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.513683 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.513881 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.513968 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.514176 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.514268 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.514486 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.514577 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.514792 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.514878 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.515096 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.515181 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.515400 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.515483 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.515699 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.515792 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.516038 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.516125 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.516359 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.516455 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.516669 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.516768 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.516979 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.517078 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.517282 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.517377 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.517603 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:40.517718 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.517940 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.518027 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.518252 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.518351 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.518562 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.518657 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.518872 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.518964 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.519193 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.519286 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.519501 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.519595 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.519833 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.519924 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.520133 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.520227 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.520449 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.520534 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.520764 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.520850 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.521085 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.521181 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.521396 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.521481 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.521707 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.521816 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.522018 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.522116 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.522325 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.522425 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.522635 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.522731 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.522953 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.523038 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.523266 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.523351 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.523571 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.523663 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.523907 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.523997 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.524229 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.524317 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.524545 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.524638 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.524868 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.524960 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.525176 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.525261 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.525493 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.525587 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.525802 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.525920 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.526110 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.526196 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.526416 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.526513 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.526744 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.526831 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.527060 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.527165 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.527365 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.527469 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.527677 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.527763 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.528020 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.528108 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.528330 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.528418 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.529198 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.529298 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.529504 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.529591 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.529806 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.529894 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.530111 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.530198 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.530410 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.530508 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.530728 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.530818 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.531048 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.531133 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.531347 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.531432 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.531657 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.531749 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.531987 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.532086 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.532296 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.532457 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.532603 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.532691 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.532903 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.532988 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.533209 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.533302 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.533513 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.533599 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.533814 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.533898 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.534125 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.534218 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.534430 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.534513 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.534730 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.534823 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.535041 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.535135 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.535340 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.535424 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.535639 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.535723 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.535972 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.536061 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.536281 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.536378 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.536589 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.536682 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.536899 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.536986 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.537205 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.537354 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.537517 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.537605 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.537822 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.537908 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.538132 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.538216 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.538442 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.538535 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.538752 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.538845 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.539065 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.539157 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.539376 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.539471 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.539689 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.539773 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.540013 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.540100 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.540320 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.540422 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.540623 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.540709 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.540924 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.541009 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.541225 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.541325 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.541530 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.541622 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.541829 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.541916 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.542129 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.542223 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.542431 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.542565 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.542730 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.542822 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.543028 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.543121 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.543333 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.543418 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.543636 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.543720 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.543956 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.544045 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.544286 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.544369 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.544587 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.544679 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.544908 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.544993 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.545218 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.545304 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.545522 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.545606 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.545827 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.545920 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.546133 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.546218 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.546473 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.546557 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.546776 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.546868 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.547092 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.547192 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.547399 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.547497 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.547707 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.547792 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.548037 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.548132 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.548344 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.548439 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.548658 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.548751 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.548965 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.549057 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.549276 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.549368 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.549578 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.549662 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.549885 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.549968 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.550189 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.550281 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.550503 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.550588 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.550802 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.550894 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.551115 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.551201 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.551440 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.551525 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.551750 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.551854 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.552092 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.552179 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.552400 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.552521 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.552707 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.552793 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.553016 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.553103 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.553322 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.553431 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.553644 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.553761 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.553952 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.554049 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.554242 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.554353 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.554556 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.554643 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.554862 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.554949 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.555175 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.555259 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.555477 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.555568 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.555785 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.555888 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.556112 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.556195 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.556422 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.556516 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.556719 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.556803 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.557034 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.557119 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.557358 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.557517 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.557684 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.557835 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.557972 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.558108 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.558264 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.558407 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.558577 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.558711 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.558884 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.559019 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.559231 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.559366 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.559508 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.559690 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.560292 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.560373 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.560600 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.560688 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.560905 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.560992 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.561216 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.561303 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.561521 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.561608 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.561829 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.561943 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.562130 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.562227 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.562437 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.562550 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.562739 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.562841 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.563038 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.563134 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.563339 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.563426 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.563641 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.563726 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.563978 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.564089 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.564289 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.564388 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.564592 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.564677 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.564900 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.564998 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.565198 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.565283 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.565497 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.565582 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.565814 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.565908 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.566118 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.566205 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.566419 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.566505 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.566720 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.566806 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.567018 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.567104 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.567338 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.567423 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.567649 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.567740 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.567969 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.568057 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.568275 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.568359 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.568581 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.568669 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.568884 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.568968 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.569193 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.569279 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.569499 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.569587 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.569803 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.569895 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.570119 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.570216 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.570429 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.570520 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.570732 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.570816 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.571039 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.571134 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.571346 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.571432 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.571653 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.571738 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.571980 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.572084 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.572291 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.572383 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.572593 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.572692 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.572905 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.573027 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.573205 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.573302 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.573502 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.573588 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.573805 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.573893 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.574116 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.574199 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.574428 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.574675 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.574769 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.575002 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.575087 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.575312 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.575423 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.575677 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.575776 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.576015 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.576266 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.576351 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.576604 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.576688 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.576925 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.577012 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.577254 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.577339 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.577619 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.577727 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.577858 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.577944 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.578156 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.578248 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.578456 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.578549 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.578758 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.578859 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.579057 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.579150 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.579357 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.579450 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.579654 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.579739 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.579980 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.580071 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.580278 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.580374 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.580577 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.580663 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.580912 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.580995 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.581208 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.581306 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.581513 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.581600 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.581810 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.581896 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.582116 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.582200 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.582412 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.582503 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.582728 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.582813 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.583033 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.583141 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.583326 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.583490 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.583623 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.583709 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.583944 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.584034 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.584281 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.584380 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.584582 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.584676 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.584889 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.584981 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.585198 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.585292 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.585505 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.585590 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.585826 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.585910 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.586126 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.586219 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.586442 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.586529 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.586740 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.586832 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.587037 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.587124 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.587332 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.587425 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.587638 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.587751 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.587961 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.588057 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.588259 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.588353 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.588562 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.588655 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.588866 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.588958 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.589170 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.589266 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.589470 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.589566 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.589768 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.589853 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.590068 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.590161 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.590364 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.590458 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.590673 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.590757 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.591476 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.591599 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.591781 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.591895 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.592096 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.592181 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.592399 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.592483 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.592704 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.592798 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.593000 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.593097 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.593304 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.593401 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.593596 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.593682 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.593904 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.593995 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.594200 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.594286 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.594498 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.594636 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.594794 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.594879 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.595096 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.595193 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.595399 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.595483 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.595695 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.595786 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.596024 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.596122 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.596329 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.596412 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.596626 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.596710 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.596925 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.597017 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.597227 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.597317 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.597524 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.597606 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.597823 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.597920 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.598129 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.598220 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.598434 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.598525 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.598741 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.598825 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.599039 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.599123 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.599342 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.599423 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.599638 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.599723 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.599958 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.600048 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.600257 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.600357 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.600559 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.600653 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.600856 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.600941 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.601154 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.601239 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.601452 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.601539 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.601747 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.601831 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.602042 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.602135 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.602344 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.602435 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.602646 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.602729 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.602942 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.603040 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.603241 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.603383 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.603539 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.603624 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.603881 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.603980 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.604191 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.604276 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.604491 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.604576 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.604802 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.604910 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.605105 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.605189 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.605420 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.605503 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.605728 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.605814 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.606032 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.606116 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.606338 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.606436 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.606679 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.606766 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.606993 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.607077 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.607298 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.607385 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.607605 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.607691 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.607934 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.608037 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.608235 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.608320 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.608549 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.608642 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.608856 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.608941 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.609159 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.609243 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.609464 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.609550 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.609770 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.609855 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.610089 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.610184 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.610388 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.610483 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.610692 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.610778 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.610997 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.611091 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.611299 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.611384 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.611600 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.611688 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.611930 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.612096 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.612240 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.612325 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.612549 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.612633 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.612852 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.612943 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.613157 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.613241 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.613462 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.613555 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.613757 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.613845 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.614059 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.614145 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.614363 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.614447 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.614663 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.614750 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.614973 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.615065 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.615273 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.615356 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.615572 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.615665 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.615900 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.615991 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.616201 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.616286 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.616506 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.616593 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.616805 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.616890 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.617109 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.617205 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.617419 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.617512 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.617726 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.617817 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.618038 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.618135 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.618346 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.618431 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.618688 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.618773 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.619000 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.619093 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.619310 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.619395 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.619608 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.619693 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.619978 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.620077 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.620293 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.620378 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.620612 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.620703 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.620926 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.621014 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.621224 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.621309 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.621521 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.621635 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.621825 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.621947 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.622143 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.622763 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.622959 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.623079 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.623258 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.623385 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.623556 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.623689 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.623900 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.624028 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.624204 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.624354 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.624520 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.624660 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.624929 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.625022 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.625235 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.625321 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.625533 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.625618 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.625860 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.625955 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.626185 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.626277 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.626519 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.626602 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.626835 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.626931 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.627149 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.627242 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.627466 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.627593 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.627766 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.628006 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.628094 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.628321 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.628417 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.628643 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.628736 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.628966 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.629058 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.629290 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.629381 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.629592 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.629684 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.629888 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.629980 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.630201 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.630285 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.630515 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.630607 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.630822 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.630907 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.631136 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.631220 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.631452 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.631545 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.631758 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.631887 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.632108 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.632204 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.632434 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.632529 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.632749 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.632859 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.633059 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.633144 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.633359 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.633473 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.633665 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.633800 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.634229 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.634378 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.634532 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.634701 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.634848 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.635028 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.635146 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.635339 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.635438 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.635647 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.635741 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.635990 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.636079 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.636299 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.636395 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.636607 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.636702 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.636929 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.637020 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.637229 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.637314 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.637537 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.637623 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.637854 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.637975 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.638200 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.638332 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.638508 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.638596 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.638807 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.638893 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.639124 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.639211 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.639426 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.639512 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.639723 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.639825 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.640045 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.640130 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.640342 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.640430 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.640679 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.640766 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.640981 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.641074 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.641294 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.641379 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.641603 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.641688 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.641908 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.642002 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.642212 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.642296 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.642514 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.642605 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.642844 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.642941 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.643147 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.643231 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.643456 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.643540 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.643776 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.643974 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.644124 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.644233 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.644437 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.644529 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.644771 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.644859 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.645097 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.645189 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.645403 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.645486 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.645701 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.645795 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.646007 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.646093 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.646305 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.646390 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.646604 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.646691 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.646903 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.646988 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.647208 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.647292 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.647511 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.647604 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.647846 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.647935 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.648145 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.648243 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.648452 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.648559 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.648750 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.648844 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.649051 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.649144 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.649373 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.649466 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.649676 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.649761 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.649997 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.650091 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.650308 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.650395 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.650612 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.650704 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.650918 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.651180 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.651277 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.651365 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.651531 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.651622 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.651855 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.651945 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.652167 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.652261 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.652480 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.652575 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.652793 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.652881 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.653103 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.653190 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.653413 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.654017 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.654302 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.654412 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.654554 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.654640 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.654865 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.654958 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.655177 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.655265 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.655488 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.655573 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.655831 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.656023 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.656145 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.656352 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.656467 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.656662 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.656779 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.656970 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.657097 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.657276 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.657414 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.657584 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.657734 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.657893 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.658199 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.658283 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.658505 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.658590 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.658813 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.658986 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.659120 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.659207 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.659441 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.659527 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.659760 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.659861 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.660104 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.660195 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.660416 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.660500 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.660732 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.660820 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.661041 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.661126 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.661352 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.661446 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.661661 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.661818 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.661987 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.662082 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.662309 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.662403 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.662612 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.662699 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.662924 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.663010 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.663233 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.663334 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.663543 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.663629 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.663871 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.663964 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.664181 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.664278 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.664492 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.664583 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.664802 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.664894 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.665110 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.665197 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.665416 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.665512 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.665722 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.665881 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.666032 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.666132 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.666348 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.666433 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.666667 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.666761 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.666980 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.667066 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.667288 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.667372 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.667596 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.667689 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.667929 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.668018 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.668246 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.668446 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.668573 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.668755 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.668909 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.669102 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.669278 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.669457 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.669597 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.669781 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.669916 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.670093 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.670232 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.670407 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.670753 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.670860 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.671070 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.671155 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.671372 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.671458 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.671681 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.671768 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.672023 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.672135 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.672324 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.672420 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.672643 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.672736 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.672951 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.673047 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.673252 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.673347 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.673563 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.673648 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.673867 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.673960 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.674178 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.674392 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.674541 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.674730 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.674818 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.675043 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.675127 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.675363 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.675451 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.675684 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.675778 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.676020 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.676122 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.676324 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.676556 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.676643 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.676901 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.676988 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.677217 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.677303 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.677528 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.677617 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.677834 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.677920 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.678136 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.678236 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.678436 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.678523 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.678741 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.678826 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.679052 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.679143 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.679349 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.679434 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.679652 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.679746 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.679978 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.680068 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.680285 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.680378 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.680591 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.680685 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.680891 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.680977 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.681190 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.681275 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.681494 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.681587 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.681793 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.681879 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.682092 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.682186 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.682393 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.682490 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.682691 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.682777 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.682996 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.683088 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.683295 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.683770 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.683923 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.684031 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.684117 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.684196 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.684286 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.684375 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.684522 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.684657 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.685355 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.685461 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.685611 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.685699 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.685929 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.686015 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.686230 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.686322 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.686529 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.686628 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.686841 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.686929 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.687146 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.687240 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.687457 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.687544 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.687763 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.687882 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.688096 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.688195 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.688402 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.688487 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.688712 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.688852 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.689033 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.689254 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.689342 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.689639 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.689724 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.689956 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.690039 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.690269 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.690359 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.690614 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.690709 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.690918 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.691014 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.691224 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.691451 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.691542 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.691851 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.691940 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.692163 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.692252 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.692472 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.692569 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.692778 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.692876 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.693085 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.693181 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.693392 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.693478 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.693698 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.693792 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.694002 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.694103 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.694306 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.694393 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.694612 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.694787 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.694920 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.695007 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.695233 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.695318 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.695550 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.695718 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.695879 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.695967 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.696192 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.696278 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.696502 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.696600 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.696808 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.696893 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.697110 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.697195 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.697413 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.697501 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.697718 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.697813 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.698029 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.698115 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.698352 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.698440 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.698660 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.698745 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.698963 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.699058 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.699272 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.699364 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.699585 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.699672 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.699921 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.700023 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.700241 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.700327 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.700634 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.700728 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.700952 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.701047 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.701264 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.701356 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.701568 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.701683 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.701880 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.702000 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.702186 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.702321 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.702510 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.702647 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.702843 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.702962 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.703164 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.703286 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.703483 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.703618 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.703784 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.703931 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.704103 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.704258 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.704404 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.704573 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.704711 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.704906 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.705003 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.705245 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.705331 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.705577 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.705664 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.705903 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.705991 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.706211 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.706297 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.706519 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.706606 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.706818 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.706902 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.707128 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.707216 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.707441 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.707527 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.707751 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.707886 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.708079 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.708173 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.708402 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.708490 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.708707 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.708794 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.709016 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.709110 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.709327 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.709413 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.709631 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.709718 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.709936 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.710029 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.710239 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.710333 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.710559 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.710643 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.710878 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.710972 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.711178 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.711266 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.711487 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.711573 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.711797 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.711901 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.712130 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.712217 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.712440 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.712526 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.712742 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.712828 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.713064 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.713157 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.713369 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.713455 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.713678 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.713766 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.713982 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.714069 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.714289 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.714391 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.714599 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.714685 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.714908 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.715003 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.715214 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.715312 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.715537 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.715659 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.715875 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.716478 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.716710 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.716806 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.717025 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.717112 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.717343 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.717430 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.717662 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.717755 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.717981 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.718068 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.718287 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.718379 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.718595 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.718689 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.718896 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.718981 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.719154 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 21 13:43:40.719250 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.719581 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.719921 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.720267 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.720598 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.720914 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.721228 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.721538 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:40.721783 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 21 13:43:40.742219 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG oslo_db.sqlalchemy.engines [None req-764ef3ed-1a97-4c04-a265-4d1f6d282ac6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108346) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 13:43:40.743350 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_db.sqlalchemy.engines [None req-14e8bd27-23b9-4080-96d8-15dd18ee6c3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108347) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 13:43:40.811257 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.context [None req-764ef3ed-1a97-4c04-a265-4d1f6d282ac6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),da1f9230-ca05-4575-ad3a-5b14aaa593ab(cell1) {{(pid=108346) load_cells /opt/stack/nova/nova/context.py:464}} Nov 21 13:43:40.811478 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.context [None req-14e8bd27-23b9-4080-96d8-15dd18ee6c3f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),da1f9230-ca05-4575-ad3a-5b14aaa593ab(cell1) {{(pid=108347) load_cells /opt/stack/nova/nova/context.py:464}} Nov 21 13:43:40.815429 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG oslo_concurrency.lockutils [None req-764ef3ed-1a97-4c04-a265-4d1f6d282ac6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:43:40.815556 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_concurrency.lockutils [None req-14e8bd27-23b9-4080-96d8-15dd18ee6c3f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:43:40.817035 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG oslo_concurrency.lockutils [None req-764ef3ed-1a97-4c04-a265-4d1f6d282ac6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:43:40.817137 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_concurrency.lockutils [None req-14e8bd27-23b9-4080-96d8-15dd18ee6c3f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:43:40.817844 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_concurrency.lockutils [None req-14e8bd27-23b9-4080-96d8-15dd18ee6c3f None None] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:43:40.817934 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG oslo_concurrency.lockutils [None req-764ef3ed-1a97-4c04-a265-4d1f6d282ac6 None None] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:43:40.819743 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_concurrency.lockutils [None req-14e8bd27-23b9-4080-96d8-15dd18ee6c3f None None] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:43:40.819850 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG oslo_concurrency.lockutils [None req-764ef3ed-1a97-4c04-a265-4d1f6d282ac6 None None] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:43:40.832487 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG oslo_db.sqlalchemy.engines [None req-764ef3ed-1a97-4c04-a265-4d1f6d282ac6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108346) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 13:43:40.833666 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_db.sqlalchemy.engines [None req-14e8bd27-23b9-4080-96d8-15dd18ee6c3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108347) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 13:43:40.835955 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG oslo_db.sqlalchemy.engines [None req-764ef3ed-1a97-4c04-a265-4d1f6d282ac6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108346) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 13:43:40.840998 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_db.sqlalchemy.engines [None req-14e8bd27-23b9-4080-96d8-15dd18ee6c3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108347) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 13:43:41.093025 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG oslo_db.sqlalchemy.engines [None req-764ef3ed-1a97-4c04-a265-4d1f6d282ac6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108346) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 13:43:41.095866 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_db.sqlalchemy.engines [None req-14e8bd27-23b9-4080-96d8-15dd18ee6c3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108347) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 13:43:41.429679 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: WARNING keystonemiddleware.auth_token [None req-764ef3ed-1a97-4c04-a265-4d1f6d282ac6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 13:43:41.436581 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: WARNING keystonemiddleware.auth_token [None req-764ef3ed-1a97-4c04-a265-4d1f6d282ac6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 13:43:41.436766 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: WARNING keystonemiddleware.auth_token [None req-14e8bd27-23b9-4080-96d8-15dd18ee6c3f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 13:43:41.443088 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: WARNING keystonemiddleware.auth_token [None req-14e8bd27-23b9-4080-96d8-15dd18ee6c3f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 13:43:41.657268 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: WARNING keystonemiddleware.auth_token [None req-764ef3ed-1a97-4c04-a265-4d1f6d282ac6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 13:43:41.662368 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: WARNING keystonemiddleware.auth_token [None req-764ef3ed-1a97-4c04-a265-4d1f6d282ac6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 13:43:41.667665 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558ff065e9c0 pid: 108346 (default app) Nov 21 13:43:41.668247 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: WARNING keystonemiddleware.auth_token [None req-14e8bd27-23b9-4080-96d8-15dd18ee6c3f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 13:43:41.669767 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-764ef3ed-1a97-4c04-a265-4d1f6d282ac6 None None] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:43:41.670915 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-764ef3ed-1a97-4c04-a265-4d1f6d282ac6 None None] 10.222.0.11 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001736 Nov 21 13:43:41.671336 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 1/1] 10.222.0.11 () {50 vars in 788 bytes} [Sun Nov 21 13:43:41 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:43:41.673433 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: WARNING keystonemiddleware.auth_token [None req-14e8bd27-23b9-4080-96d8-15dd18ee6c3f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 13:43:41.678740 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558ff065e9c0 pid: 108347 (default app) Nov 21 13:45:02.090448 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-764ef3ed-1a97-4c04-a265-4d1f6d282ac6 None None] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:02.091461 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-764ef3ed-1a97-4c04-a265-4d1f6d282ac6 None None] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Nov 21 13:45:02.092030 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 2/2] 10.222.0.11 () {54 vars in 930 bytes} [Sun Nov 21 13:45:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:45:02.630679 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-0dedd788-e4fa-48f0-86ca-fecc9240fc08 admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:02.660508 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-0dedd788-e4fa-48f0-86ca-fecc9240fc08 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.561539 Nov 21 13:45:02.661242 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 1/3] 10.222.0.11 () {60 vars in 1291 bytes} [Sun Nov 21 13:45:02 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:45:04.965343 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-764ef3ed-1a97-4c04-a265-4d1f6d282ac6 None None] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:04.966879 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-764ef3ed-1a97-4c04-a265-4d1f6d282ac6 None None] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001939 Nov 21 13:45:04.967948 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 3/4] 10.222.0.11 () {54 vars in 930 bytes} [Sun Nov 21 13:45:04 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:45:05.034901 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-a3ef4394-10d3-4481-b022-33be3b57f720 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "disk": 1, "swap": 0}} {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:45:05.053903 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:45:05.053903 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: warnings.warn(msg) Nov 21 13:45:05.083756 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-a3ef4394-10d3-4481-b022-33be3b57f720 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.110240 Nov 21 13:45:05.084799 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 2/5] 10.222.0.11 () {64 vars in 1282 bytes} [Sun Nov 21 13:45:04 2021] POST /compute/v2.1/flavors => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 13:45:05.428886 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-6f3172bc-490c-4454-aff2-17b724bf189c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:45:05.431229 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:45:05.431229 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: warnings.warn(msg) Nov 21 13:45:05.490270 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-6f3172bc-490c-4454-aff2-17b724bf189c admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.396941 Nov 21 13:45:05.501421 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 4/6] 10.222.0.11 () {64 vars in 1335 bytes} [Sun Nov 21 13:45:05 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:45:07.757901 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-a3ef4394-10d3-4481-b022-33be3b57f720 admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:07.759191 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-a3ef4394-10d3-4481-b022-33be3b57f720 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001728 Nov 21 13:45:07.759831 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 3/7] 10.222.0.11 () {54 vars in 930 bytes} [Sun Nov 21 13:45:07 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:45:07.873943 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-401e1ce9-5b48-4cd3-b6da-95c8193ce0f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 5, "id": "d1", "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M"}} {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:45:07.894980 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:45:07.894980 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: warnings.warn(msg) Nov 21 13:45:07.914785 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-401e1ce9-5b48-4cd3-b6da-95c8193ce0f4 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.148347 Nov 21 13:45:07.915357 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 5/8] 10.222.0.11 () {64 vars in 1282 bytes} [Sun Nov 21 13:45:07 2021] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:45:07.928125 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-a93cf8ef-31b6-49db-ba3b-d96298ebd20c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:45:07.929985 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:45:07.929985 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: warnings.warn(msg) Nov 21 13:45:07.966053 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-a93cf8ef-31b6-49db-ba3b-d96298ebd20c admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041777 Nov 21 13:45:07.967991 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 4/9] 10.222.0.11 () {64 vars in 1335 bytes} [Sun Nov 21 13:45:07 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:45:10.280658 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-401e1ce9-5b48-4cd3-b6da-95c8193ce0f4 admin admin] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:10.281687 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-401e1ce9-5b48-4cd3-b6da-95c8193ce0f4 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Nov 21 13:45:10.282301 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 6/10] 10.222.0.11 () {54 vars in 930 bytes} [Sun Nov 21 13:45:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:45:10.359653 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-968d07da-2f10-405c-b021-8c4ac31608de admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "swap": 0, "name": "ds1G", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:45:10.379664 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-968d07da-2f10-405c-b021-8c4ac31608de admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.090129 Nov 21 13:45:10.388301 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 5/11] 10.222.0.11 () {64 vars in 1282 bytes} [Sun Nov 21 13:45:10 2021] POST /compute/v2.1/flavors => generated 404 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:45:10.393353 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-40eff583-d892-4b06-9e58-c045fe97a0c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:45:10.419725 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-40eff583-d892-4b06-9e58-c045fe97a0c4 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029536 Nov 21 13:45:10.434927 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 7/12] 10.222.0.11 () {64 vars in 1335 bytes} [Sun Nov 21 13:45:10 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:45:12.733099 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-968d07da-2f10-405c-b021-8c4ac31608de admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:12.734119 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-968d07da-2f10-405c-b021-8c4ac31608de admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Nov 21 13:45:12.734519 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 6/13] 10.222.0.11 () {54 vars in 930 bytes} [Sun Nov 21 13:45:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:45:12.814552 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-9724fb98-07d7-40aa-9e32-d684076ec308 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "swap": 0, "disk": 10, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:45:12.832005 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-9724fb98-07d7-40aa-9e32-d684076ec308 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.091254 Nov 21 13:45:12.832814 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 8/14] 10.222.0.11 () {64 vars in 1282 bytes} [Sun Nov 21 13:45:12 2021] POST /compute/v2.1/flavors => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:45:12.846830 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-e181290e-7437-4b58-a99b-2544e592f233 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:45:12.878004 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-e181290e-7437-4b58-a99b-2544e592f233 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034853 Nov 21 13:45:12.885189 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 7/15] 10.222.0.11 () {64 vars in 1335 bytes} [Sun Nov 21 13:45:12 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:45:15.161411 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-9724fb98-07d7-40aa-9e32-d684076ec308 admin admin] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:15.162420 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-9724fb98-07d7-40aa-9e32-d684076ec308 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Nov 21 13:45:15.162826 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 9/16] 10.222.0.11 () {54 vars in 930 bytes} [Sun Nov 21 13:45:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:45:15.224269 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-c3bd5cfb-a9e3-4544-a13c-7c1bac91a89c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d4", "name": "ds4G", "rxtx_factor": 1.0, "disk": 20}} {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:45:15.244117 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-c3bd5cfb-a9e3-4544-a13c-7c1bac91a89c admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074608 Nov 21 13:45:15.248371 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 8/17] 10.222.0.11 () {64 vars in 1282 bytes} [Sun Nov 21 13:45:15 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:45:15.257210 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-c1557b47-0442-4d02-a4f8-9c8a0cd295f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:45:15.282847 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-c1557b47-0442-4d02-a4f8-9c8a0cd295f3 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029337 Nov 21 13:45:15.285120 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 10/18] 10.222.0.11 () {64 vars in 1335 bytes} [Sun Nov 21 13:45:15 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:45:17.723437 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-c3bd5cfb-a9e3-4544-a13c-7c1bac91a89c admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:17.724610 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-c3bd5cfb-a9e3-4544-a13c-7c1bac91a89c admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001690 Nov 21 13:45:17.725056 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 9/19] 10.222.0.11 () {54 vars in 930 bytes} [Sun Nov 21 13:45:17 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:45:17.788278 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-235b3516-ad3a-4324-823f-feaef313554b admin admin] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:17.815348 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-235b3516-ad3a-4324-823f-feaef313554b admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083838 Nov 21 13:45:17.815929 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 11/20] 10.222.0.11 () {60 vars in 1291 bytes} [Sun Nov 21 13:45:17 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:45:20.282632 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-c3bd5cfb-a9e3-4544-a13c-7c1bac91a89c admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:20.283658 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-c3bd5cfb-a9e3-4544-a13c-7c1bac91a89c admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Nov 21 13:45:20.284103 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 10/21] 10.222.0.11 () {54 vars in 930 bytes} [Sun Nov 21 13:45:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:45:20.345354 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-4fcaaeb3-2071-43d6-b347-8a3a17df6b19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "m1.tiny", "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "1"}} {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:45:20.364539 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-4fcaaeb3-2071-43d6-b347-8a3a17df6b19 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.070959 Nov 21 13:45:20.365119 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 12/22] 10.222.0.11 () {64 vars in 1282 bytes} [Sun Nov 21 13:45:20 2021] POST /compute/v2.1/flavors => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:45:20.377109 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-db958747-b4fe-4738-93e0-30f9d2eac7ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:45:20.401989 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-db958747-b4fe-4738-93e0-30f9d2eac7ee admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028434 Nov 21 13:45:20.402595 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 11/23] 10.222.0.11 () {64 vars in 1332 bytes} [Sun Nov 21 13:45:20 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:45:22.764479 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-4fcaaeb3-2071-43d6-b347-8a3a17df6b19 admin admin] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:22.765528 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-4fcaaeb3-2071-43d6-b347-8a3a17df6b19 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Nov 21 13:45:22.765959 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 13/24] 10.222.0.11 () {54 vars in 930 bytes} [Sun Nov 21 13:45:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:45:22.830087 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-f161b7f3-3efa-4e39-b296-6fa1751d9565 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "disk": 20}} {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:45:22.852876 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-f161b7f3-3efa-4e39-b296-6fa1751d9565 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.080060 Nov 21 13:45:22.853538 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 12/25] 10.222.0.11 () {64 vars in 1282 bytes} [Sun Nov 21 13:45:22 2021] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:45:22.866238 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-64894657-e432-4c38-ac59-6f2bf53fb1ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:45:22.891499 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-64894657-e432-4c38-ac59-6f2bf53fb1ec admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029049 Nov 21 13:45:22.892137 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 14/26] 10.222.0.11 () {64 vars in 1332 bytes} [Sun Nov 21 13:45:22 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:45:25.375027 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-f161b7f3-3efa-4e39-b296-6fa1751d9565 admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:25.376096 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-f161b7f3-3efa-4e39-b296-6fa1751d9565 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Nov 21 13:45:25.376505 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 13/27] 10.222.0.11 () {54 vars in 930 bytes} [Sun Nov 21 13:45:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:45:25.434159 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-0d3ac6e5-2b3e-4e94-9f82-f01aafd7b61a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "swap": 0, "vcpus": 2, "name": "m1.medium"}} {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:45:25.451816 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-0d3ac6e5-2b3e-4e94-9f82-f01aafd7b61a admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.068909 Nov 21 13:45:25.452379 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 15/28] 10.222.0.11 () {64 vars in 1282 bytes} [Sun Nov 21 13:45:25 2021] POST /compute/v2.1/flavors => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:45:25.464533 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-a3e8830c-58e2-469b-bea4-754a63437d4f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:45:25.487422 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-a3e8830c-58e2-469b-bea4-754a63437d4f admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026569 Nov 21 13:45:25.488029 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 14/29] 10.222.0.11 () {64 vars in 1332 bytes} [Sun Nov 21 13:45:25 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:45:27.809424 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-0d3ac6e5-2b3e-4e94-9f82-f01aafd7b61a admin admin] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:27.810503 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-0d3ac6e5-2b3e-4e94-9f82-f01aafd7b61a admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001868 Nov 21 13:45:27.810905 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 16/30] 10.222.0.11 () {54 vars in 930 bytes} [Sun Nov 21 13:45:27 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:45:27.884758 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-8580a2db-dd61-4aee-a0cc-796621fd8fad admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 80}} {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:45:27.909066 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-8580a2db-dd61-4aee-a0cc-796621fd8fad admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.091003 Nov 21 13:45:27.910418 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 15/31] 10.222.0.11 () {64 vars in 1282 bytes} [Sun Nov 21 13:45:27 2021] POST /compute/v2.1/flavors => generated 405 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 13:45:27.925540 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-e97c8564-710a-4550-ba3f-0c7542c19c25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:45:27.949027 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-e97c8564-710a-4550-ba3f-0c7542c19c25 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027898 Nov 21 13:45:27.950181 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 17/32] 10.222.0.11 () {64 vars in 1332 bytes} [Sun Nov 21 13:45:27 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:45:30.261102 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-8580a2db-dd61-4aee-a0cc-796621fd8fad admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:30.262703 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-8580a2db-dd61-4aee-a0cc-796621fd8fad admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002028 Nov 21 13:45:30.263103 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 16/33] 10.222.0.11 () {54 vars in 930 bytes} [Sun Nov 21 13:45:30 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:45:30.325876 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-c7d121dc-bd07-43fa-8c3b-a4c1e967d4fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "disk": 160, "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384, "rxtx_factor": 1.0}} {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:45:30.350926 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-c7d121dc-bd07-43fa-8c3b-a4c1e967d4fd admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.081324 Nov 21 13:45:30.351599 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 18/34] 10.222.0.11 () {64 vars in 1282 bytes} [Sun Nov 21 13:45:30 2021] POST /compute/v2.1/flavors => generated 408 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:45:30.364384 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-3d0afb9c-9884-4bc6-b1cf-9849dc7caaf3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:45:30.389097 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-3d0afb9c-9884-4bc6-b1cf-9849dc7caaf3 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028114 Nov 21 13:45:30.389921 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 17/35] 10.222.0.11 () {64 vars in 1332 bytes} [Sun Nov 21 13:45:30 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:45:52.536269 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-c7d121dc-bd07-43fa-8c3b-a4c1e967d4fd admin admin] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:52.537297 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-c7d121dc-bd07-43fa-8c3b-a4c1e967d4fd admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Nov 21 13:45:52.537688 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 19/36] 10.222.0.11 () {54 vars in 930 bytes} [Sun Nov 21 13:45:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:45:52.598491 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-60e1c1ac-ce86-4ef1-a288-6da05e343808 admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:52.615453 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-60e1c1ac-ce86-4ef1-a288-6da05e343808 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070549 Nov 21 13:45:52.616012 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 18/37] 10.222.0.11 () {60 vars in 1291 bytes} [Sun Nov 21 13:45:52 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:45:54.098241 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-c7d121dc-bd07-43fa-8c3b-a4c1e967d4fd admin admin] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:54.099266 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-c7d121dc-bd07-43fa-8c3b-a4c1e967d4fd admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Nov 21 13:45:54.099656 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 20/38] 10.222.0.11 () {56 vars in 1074 bytes} [Sun Nov 21 13:45:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:45:54.304924 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-3cc0cb3d-3a1c-423f-9af8-734da6f01d24 admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:54.310386 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.wsgi [None req-3cc0cb3d-3a1c-423f-9af8-734da6f01d24 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 21 13:45:54.310898 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-3cc0cb3d-3a1c-423f-9af8-734da6f01d24 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108347) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:45:54.311694 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-3cc0cb3d-3a1c-423f-9af8-734da6f01d24 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058751 Nov 21 13:45:54.312238 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 19/39] 10.222.0.11 () {60 vars in 1190 bytes} [Sun Nov 21 13:45:54 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 21 13:45:54.321814 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-bd8899d2-f288-4cde-bf43-77f968ff9644 admin admin] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:54.342030 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-bd8899d2-f288-4cde-bf43-77f968ff9644 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023694 Nov 21 13:45:54.342545 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 21/40] 10.222.0.11 () {60 vars in 1210 bytes} [Sun Nov 21 13:45:54 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:45:54.352073 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-6dd94001-7e3b-4c29-9321-f91555c879b5 admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:54.372996 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-6dd94001-7e3b-4c29-9321-f91555c879b5 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024307 Nov 21 13:45:54.373514 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 20/41] 10.222.0.11 () {60 vars in 1210 bytes} [Sun Nov 21 13:45:54 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:45:54.383340 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-bdc75311-e930-456f-8a55-04dd8696d005 admin admin] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:54.388678 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.wsgi [None req-bdc75311-e930-456f-8a55-04dd8696d005 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 21 13:45:54.389230 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-bdc75311-e930-456f-8a55-04dd8696d005 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:45:54.389998 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-bdc75311-e930-456f-8a55-04dd8696d005 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010376 Nov 21 13:45:54.390483 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 22/42] 10.222.0.11 () {60 vars in 1190 bytes} [Sun Nov 21 13:45:54 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 21 13:45:55.752481 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-6dd94001-7e3b-4c29-9321-f91555c879b5 admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:55.753515 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-6dd94001-7e3b-4c29-9321-f91555c879b5 admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Nov 21 13:45:55.753908 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 21/43] 10.222.0.11 () {56 vars in 1074 bytes} [Sun Nov 21 13:45:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:45:55.943391 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-e74aac36-3558-4a44-a1ca-4aab7bdad88f admin admin] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:55.949584 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.wsgi [None req-e74aac36-3558-4a44-a1ca-4aab7bdad88f admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 21 13:45:55.950134 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-e74aac36-3558-4a44-a1ca-4aab7bdad88f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:45:55.950914 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-e74aac36-3558-4a44-a1ca-4aab7bdad88f admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058495 Nov 21 13:45:55.951404 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 23/44] 10.222.0.11 () {60 vars in 1190 bytes} [Sun Nov 21 13:45:55 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 21 13:45:55.960923 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-eb2cb19e-be21-4d4a-9375-a21884718e24 admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:55.974896 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-eb2cb19e-be21-4d4a-9375-a21884718e24 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017422 Nov 21 13:45:55.975497 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 22/45] 10.222.0.11 () {60 vars in 1210 bytes} [Sun Nov 21 13:45:55 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:45:55.984945 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-109d5237-1bcf-4b2f-8e62-a120f8ac800b admin admin] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:55.998039 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-109d5237-1bcf-4b2f-8e62-a120f8ac800b admin admin] 10.222.0.11 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016375 Nov 21 13:45:55.998556 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 24/46] 10.222.0.11 () {60 vars in 1210 bytes} [Sun Nov 21 13:45:55 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 13:45:56.008417 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-15dbb4a6-4d24-4601-9579-02f873cff5be admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:56.013974 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.wsgi [None req-15dbb4a6-4d24-4601-9579-02f873cff5be admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 21 13:45:56.014535 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-15dbb4a6-4d24-4601-9579-02f873cff5be admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108347) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:45:56.015318 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-15dbb4a6-4d24-4601-9579-02f873cff5be admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010728 Nov 21 13:45:56.015825 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 23/47] 10.222.0.11 () {60 vars in 1190 bytes} [Sun Nov 21 13:45:56 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 21 13:45:57.380755 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-109d5237-1bcf-4b2f-8e62-a120f8ac800b admin admin] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:57.381762 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-109d5237-1bcf-4b2f-8e62-a120f8ac800b admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Nov 21 13:45:57.382161 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 25/48] 10.222.0.11 () {56 vars in 1074 bytes} [Sun Nov 21 13:45:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:45:57.572472 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-efc05aec-d79d-4f4f-bca1-3480f6fc56b2 admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:57.577675 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.wsgi [None req-efc05aec-d79d-4f4f-bca1-3480f6fc56b2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 21 13:45:57.578240 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-efc05aec-d79d-4f4f-bca1-3480f6fc56b2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108347) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:45:57.579033 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-efc05aec-d79d-4f4f-bca1-3480f6fc56b2 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057606 Nov 21 13:45:57.579529 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 24/49] 10.222.0.11 () {60 vars in 1193 bytes} [Sun Nov 21 13:45:57 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 21 13:45:57.590668 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-9891a757-34cd-4154-a843-4c49991910d1 admin admin] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:57.604396 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-9891a757-34cd-4154-a843-4c49991910d1 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018803 Nov 21 13:45:57.604918 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 26/50] 10.222.0.11 () {60 vars in 1210 bytes} [Sun Nov 21 13:45:57 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:45:57.614926 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-6e7c003e-5492-4cc7-b86d-5c81f53e9cec admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:57.628218 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-6e7c003e-5492-4cc7-b86d-5c81f53e9cec admin admin] 10.222.0.11 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017020 Nov 21 13:45:57.628743 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 25/51] 10.222.0.11 () {60 vars in 1210 bytes} [Sun Nov 21 13:45:57 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:45:57.638515 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-89cd51e8-d182-4e07-b6ca-1ece72299fd4 admin admin] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:57.643523 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.wsgi [None req-89cd51e8-d182-4e07-b6ca-1ece72299fd4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 21 13:45:57.644116 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-89cd51e8-d182-4e07-b6ca-1ece72299fd4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:45:57.644881 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-89cd51e8-d182-4e07-b6ca-1ece72299fd4 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009822 Nov 21 13:45:57.645361 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 27/52] 10.222.0.11 () {60 vars in 1193 bytes} [Sun Nov 21 13:45:57 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 21 13:45:59.021414 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-6e7c003e-5492-4cc7-b86d-5c81f53e9cec admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:45:59.022409 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-6e7c003e-5492-4cc7-b86d-5c81f53e9cec admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Nov 21 13:45:59.022837 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 26/53] 10.222.0.11 () {56 vars in 1074 bytes} [Sun Nov 21 13:45:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:45:59.211373 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-f04d152a-373d-4b0e-bcf1-78a363f6a41e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:45:59.229029 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-f04d152a-373d-4b0e-bcf1-78a363f6a41e admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068469 Nov 21 13:45:59.229608 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 28/54] 10.222.0.11 () {64 vars in 1235 bytes} [Sun Nov 21 13:45:59 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:46:00.613370 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-6e7c003e-5492-4cc7-b86d-5c81f53e9cec admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:46:00.614365 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-6e7c003e-5492-4cc7-b86d-5c81f53e9cec admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001390 Nov 21 13:46:00.614788 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 27/55] 10.222.0.11 () {56 vars in 1074 bytes} [Sun Nov 21 13:46:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:46:00.801438 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-b79b5471-0b68-487b-8970-40121bf01d9b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:46:00.818575 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-b79b5471-0b68-487b-8970-40121bf01d9b admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068699 Nov 21 13:46:00.819106 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 29/56] 10.222.0.11 () {64 vars in 1235 bytes} [Sun Nov 21 13:46:00 2021] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:46:02.206068 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-6e7c003e-5492-4cc7-b86d-5c81f53e9cec admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:46:02.207076 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-6e7c003e-5492-4cc7-b86d-5c81f53e9cec admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Nov 21 13:46:02.207475 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 28/57] 10.222.0.11 () {56 vars in 1074 bytes} [Sun Nov 21 13:46:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:46:02.404634 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-0e6300d5-896a-4d54-a476-88d614a77cd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:46:02.422282 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-0e6300d5-896a-4d54-a476-88d614a77cd3 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069208 Nov 21 13:46:02.422807 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 30/58] 10.222.0.11 () {64 vars in 1235 bytes} [Sun Nov 21 13:46:02 2021] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:46:03.806540 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-6e7c003e-5492-4cc7-b86d-5c81f53e9cec admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:46:03.808281 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-6e7c003e-5492-4cc7-b86d-5c81f53e9cec admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002160 Nov 21 13:46:03.808281 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 29/59] 10.222.0.11 () {56 vars in 1074 bytes} [Sun Nov 21 13:46:03 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:46:03.997863 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-7f169ed2-cfce-41b6-ac5a-fafad07e34d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:46:04.015377 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-7f169ed2-cfce-41b6-ac5a-fafad07e34d6 admin admin] 10.222.0.11 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068431 Nov 21 13:46:04.015934 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 31/60] 10.222.0.11 () {64 vars in 1235 bytes} [Sun Nov 21 13:46:03 2021] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:46:05.392484 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-6e7c003e-5492-4cc7-b86d-5c81f53e9cec admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:46:05.393517 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-6e7c003e-5492-4cc7-b86d-5c81f53e9cec admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Nov 21 13:46:05.393917 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 30/61] 10.222.0.11 () {56 vars in 1074 bytes} [Sun Nov 21 13:46:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:46:05.589666 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-26555791-9d27-4d57-a7fa-09b414106dff admin admin] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:46:05.608203 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-26555791-9d27-4d57-a7fa-09b414106dff admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072858 Nov 21 13:46:05.608751 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 32/62] 10.222.0.11 () {60 vars in 1202 bytes} [Sun Nov 21 13:46:05 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:46:51.375862 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-6e7c003e-5492-4cc7-b86d-5c81f53e9cec admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:46:51.376875 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-6e7c003e-5492-4cc7-b86d-5c81f53e9cec admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Nov 21 13:46:51.377276 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 31/63] 10.222.0.11 () {54 vars in 930 bytes} [Sun Nov 21 13:46:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:46:51.435632 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-26b2ad61-8e53-4110-b919-b287346e368d admin admin] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:46:51.454335 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-26b2ad61-8e53-4110-b919-b287346e368d admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069671 Nov 21 13:46:51.454864 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 33/64] 10.222.0.11 () {60 vars in 1291 bytes} [Sun Nov 21 13:46:51 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:46:51.479676 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-ce49cfeb-153e-4d6f-844f-ed1369397899 admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:46:51.487159 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-ce49cfeb-153e-4d6f-844f-ed1369397899 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011530 Nov 21 13:46:51.487669 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 32/65] 10.222.0.11 () {60 vars in 1282 bytes} [Sun Nov 21 13:46:51 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:46:51.498760 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-3d2b49b8-5b1b-42db-8750-52daeb235824 admin admin] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:46:51.506127 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-3d2b49b8-5b1b-42db-8750-52daeb235824 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010709 Nov 21 13:46:51.506634 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 34/66] 10.222.0.11 () {60 vars in 1285 bytes} [Sun Nov 21 13:46:51 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:46:51.518317 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-594e1514-dc67-4236-9c1d-558fdd4946e0 admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:46:51.526174 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-594e1514-dc67-4236-9c1d-558fdd4946e0 admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011149 Nov 21 13:46:51.526684 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 33/67] 10.222.0.11 () {60 vars in 1285 bytes} [Sun Nov 21 13:46:51 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:46:51.537512 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-69a99740-d634-4577-8395-f7e18d60c88f admin admin] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:46:51.544931 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-69a99740-d634-4577-8395-f7e18d60c88f admin admin] 10.222.0.11 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010556 Nov 21 13:46:51.545389 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 35/68] 10.222.0.11 () {60 vars in 1282 bytes} [Sun Nov 21 13:46:51 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:48:18.599789 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-88ca67ce-6d76-47ed-b2c7-cdf053d38b06 tempest-verify_tempest_config-1361804759 tempest-verify_tempest_config-1361804759-project] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:48:18.601849 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-88ca67ce-6d76-47ed-b2c7-cdf053d38b06 tempest-verify_tempest_config-1361804759 tempest-verify_tempest_config-1361804759-project] 10.222.0.11 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.103204 Nov 21 13:48:18.602379 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 34/69] 10.222.0.11 () {58 vars in 1133 bytes} [Sun Nov 21 13:48:18 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:49:47.092071 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-69a99740-d634-4577-8395-f7e18d60c88f admin admin] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:49:47.093075 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-69a99740-d634-4577-8395-f7e18d60c88f admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Nov 21 13:49:47.093474 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 36/70] 10.222.0.11 () {56 vars in 1074 bytes} [Sun Nov 21 13:49:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:49:47.363662 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-501b1274-05b5-43a1-9474-a73c7bc110ff admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:49:47.364867 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:49:47.364867 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: warnings.warn(msg) Nov 21 13:49:47.366431 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_concurrency.lockutils [None req-501b1274-05b5-43a1-9474-a73c7bc110ff admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:49:47.366872 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_concurrency.lockutils [None req-501b1274-05b5-43a1-9474-a73c7bc110ff admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:49:47.367687 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_concurrency.lockutils [None req-501b1274-05b5-43a1-9474-a73c7bc110ff admin admin] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:49:47.368165 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_concurrency.lockutils [None req-501b1274-05b5-43a1-9474-a73c7bc110ff admin admin] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:49:47.401008 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-501b1274-05b5-43a1-9474-a73c7bc110ff admin admin] 10.222.0.11 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.156984 Nov 21 13:49:47.401553 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 35/71] 10.222.0.11 () {60 vars in 1193 bytes} [Sun Nov 21 13:49:47 2021] GET /compute/v2.1/os-services => generated 794 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:49:48.805555 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-69a99740-d634-4577-8395-f7e18d60c88f admin admin] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:49:48.806539 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-69a99740-d634-4577-8395-f7e18d60c88f admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Nov 21 13:49:48.806919 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 37/72] 10.222.0.11 () {56 vars in 1074 bytes} [Sun Nov 21 13:49:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:49:48.999164 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-9eac5251-9420-4e87-88df-cd0c52f37c0c admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:49:49.000393 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:49:49.000393 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: warnings.warn(msg) Nov 21 13:49:49.001928 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_concurrency.lockutils [None req-9eac5251-9420-4e87-88df-cd0c52f37c0c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:49:49.002396 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_concurrency.lockutils [None req-9eac5251-9420-4e87-88df-cd0c52f37c0c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:49:49.003198 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_concurrency.lockutils [None req-9eac5251-9420-4e87-88df-cd0c52f37c0c admin admin] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:49:49.003627 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_concurrency.lockutils [None req-9eac5251-9420-4e87-88df-cd0c52f37c0c admin admin] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:49:49.025210 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-9eac5251-9420-4e87-88df-cd0c52f37c0c admin admin] 10.222.0.11 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077731 Nov 21 13:49:49.025787 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 36/73] 10.222.0.11 () {60 vars in 1193 bytes} [Sun Nov 21 13:49:48 2021] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:50:00.840468 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-69a99740-d634-4577-8395-f7e18d60c88f admin admin] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:50:00.841502 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-69a99740-d634-4577-8395-f7e18d60c88f admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Nov 21 13:50:00.841910 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 38/74] 10.222.0.11 () {56 vars in 1074 bytes} [Sun Nov 21 13:50:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:50:01.039064 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-f266ce17-c3de-41d4-93ca-e222120ce002 admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:50:01.040260 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:50:01.040260 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: warnings.warn(msg) Nov 21 13:50:01.041819 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_concurrency.lockutils [None req-f266ce17-c3de-41d4-93ca-e222120ce002 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:50:01.042253 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_concurrency.lockutils [None req-f266ce17-c3de-41d4-93ca-e222120ce002 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:50:01.043031 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_concurrency.lockutils [None req-f266ce17-c3de-41d4-93ca-e222120ce002 admin admin] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:50:01.043484 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_concurrency.lockutils [None req-f266ce17-c3de-41d4-93ca-e222120ce002 admin admin] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:50:01.068870 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-f266ce17-c3de-41d4-93ca-e222120ce002 admin admin] 10.222.0.11 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080870 Nov 21 13:50:01.069367 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 37/75] 10.222.0.11 () {60 vars in 1193 bytes} [Sun Nov 21 13:50:00 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:50:02.456361 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: DEBUG nova.api.openstack.wsgi [None req-69a99740-d634-4577-8395-f7e18d60c88f admin admin] Calling method '>' {{(pid=108346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:50:02.457364 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: INFO nova.api.openstack.requestlog [None req-69a99740-d634-4577-8395-f7e18d60c88f admin admin] 10.222.0.11 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Nov 21 13:50:02.457769 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: [pid: 108346|app: 0|req: 39/76] 10.222.0.11 () {56 vars in 1074 bytes} [Sun Nov 21 13:50:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:50:02.650988 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG nova.api.openstack.wsgi [None req-e40bdcc4-d935-4b62-b40f-892ad4c01dd5 admin admin] Calling method '>' {{(pid=108347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:50:02.652156 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:50:02.652156 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: warnings.warn(msg) Nov 21 13:50:02.653686 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_concurrency.lockutils [None req-e40bdcc4-d935-4b62-b40f-892ad4c01dd5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:50:02.654121 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_concurrency.lockutils [None req-e40bdcc4-d935-4b62-b40f-892ad4c01dd5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:50:02.654963 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_concurrency.lockutils [None req-e40bdcc4-d935-4b62-b40f-892ad4c01dd5 admin admin] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:50:02.655388 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: DEBUG oslo_concurrency.lockutils [None req-e40bdcc4-d935-4b62-b40f-892ad4c01dd5 admin admin] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:50:02.675702 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: INFO nova.api.openstack.requestlog [None req-e40bdcc4-d935-4b62-b40f-892ad4c01dd5 admin admin] 10.222.0.11 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.075753 Nov 21 13:50:02.676206 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: [pid: 108347|app: 0|req: 38/77] 10.222.0.11 () {60 vars in 1193 bytes} [Sun Nov 21 13:50:02 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 13:50:59.855889 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: Sun Nov 21 13:50:59 2021 - graceful shutdown triggered... Nov 21 13:50:59.856018 dv-cinder-768458-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 21 13:50:59.856806 dv-cinder-768458-12-iscsi devstack@n-api.service[108346]: Gracefully killing worker 1 (pid: 108346)... Nov 21 13:50:59.857749 dv-cinder-768458-12-iscsi devstack@n-api.service[108347]: Gracefully killing worker 2 (pid: 108347)... Nov 21 13:51:00.857753 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: worker 1 buried after 1 seconds Nov 21 13:51:00.857753 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: worker 2 buried after 1 seconds Nov 21 13:51:00.858393 dv-cinder-768458-12-iscsi devstack@n-api.service[108345]: goodbye to uWSGI. Nov 21 13:51:00.859339 dv-cinder-768458-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 21 13:51:00.859939 dv-cinder-768458-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 21 13:51:00.863046 dv-cinder-768458-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 21 13:51:00.872484 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 21 13:51:00.875049 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Nov 21 13:51:00 2021] *** Nov 21 13:51:00.875049 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 21 13:51:00.875049 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 21 13:51:00.875049 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: nodename: dv-cinder-768458-12-iscsi Nov 21 13:51:00.875049 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: machine: x86_64 Nov 21 13:51:00.875049 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: clock source: unix Nov 21 13:51:00.875049 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: pcre jit disabled Nov 21 13:51:00.875049 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: detected number of CPU cores: 4 Nov 21 13:51:00.875049 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: current working directory: / Nov 21 13:51:00.875049 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: detected binary path: /usr/bin/uwsgi-core Nov 21 13:51:00.875049 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: your processes number limit is 47680 Nov 21 13:51:00.875946 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: your memory page size is 4096 bytes Nov 21 13:51:00.875946 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: detected max file descriptor number: 2048 Nov 21 13:51:00.875946 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: lock engine: pthread robust mutexes Nov 21 13:51:00.875946 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: thunder lock: enabled Nov 21 13:51:00.875946 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 21 13:51:00.875946 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 21 13:51:00.921064 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: Python main interpreter initialized at 0x5591d09bd9c0 Nov 21 13:51:00.921064 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: python threads support enabled Nov 21 13:51:00.921064 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: your server socket listen backlog is limited to 100 connections Nov 21 13:51:00.921064 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: your mercy for graceful operations on workers is 90 seconds Nov 21 13:51:00.921483 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: mapped 403077 bytes (393 KB) for 2 cores Nov 21 13:51:00.921483 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: *** Operational MODE: preforking *** Nov 21 13:51:00.921786 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: *** uWSGI is running in multiple interpreter mode *** Nov 21 13:51:00.921786 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: spawned uWSGI master process (pid: 122544) Nov 21 13:51:00.922011 dv-cinder-768458-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 21 13:51:00.922558 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: spawned uWSGI worker 1 (pid: 122564, cores: 1) Nov 21 13:51:00.923108 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: spawned uWSGI worker 2 (pid: 122565, cores: 1) Nov 21 13:51:00.923428 dv-cinder-768458-12-iscsi devstack@n-api.service[122544]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 21 13:51:02.708921 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 21 13:51:02.708921 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: from cryptography.utils import int_from_bytes Nov 21 13:51:02.709717 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 21 13:51:02.709717 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: from cryptography.utils import int_from_bytes Nov 21 13:51:02.711003 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 21 13:51:02.711003 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: from cryptography.utils import int_from_bytes Nov 21 13:51:02.711469 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 21 13:51:02.711469 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: from cryptography.utils import int_from_bytes Nov 21 13:51:05.059187 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 21 13:51:05.059840 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 21 13:51:05.059948 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 21 13:51:05.060316 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 21 13:51:05.060575 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 21 13:51:05.060970 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.061310 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.061649 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.061973 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.062398 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.062722 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.063065 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.063393 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.063737 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.064030 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.064356 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.064504 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 21 13:51:05.064883 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-12-iscsi {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.064982 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 21 13:51:05.065074 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.065269 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 21 13:51:05.065408 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.065605 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.065710 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 21 13:51:05.065887 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 21 13:51:05.065989 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.066245 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.066417 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.066589 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.066751 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.066904 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.067082 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.067393 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.067521 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.067861 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.068786 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.069057 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.069392 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.069553 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.069734 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.069840 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.070004 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.070167 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.070339 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.070515 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.070711 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-12-iscsi {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.070874 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.071048 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.071149 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.071385 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.071497 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.071750 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.071879 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.072110 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.072214 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.072427 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.072536 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.072809 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.072907 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-12-iscsi {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.073191 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.073523 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.073633 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.073953 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.074098 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.074319 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.074482 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.074635 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.074785 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.074936 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.075143 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.075438 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.075564 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.075672 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.075866 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.076029 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.076215 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.076373 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.076552 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.076717 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.076895 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.077048 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.077207 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.077348 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.077494 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.077643 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.077809 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.077973 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-12-iscsi {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.078125 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.078274 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.078432 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.078580 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.078721 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.078869 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.079016 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.079218 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.079365 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.079518 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.079665 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.079914 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.080074 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.080225 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.080373 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.080556 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.080710 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.080858 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.081047 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.081199 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.081343 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.081585 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.081735 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.081895 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.082049 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.082200 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.082347 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.082496 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.082646 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.082794 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.082952 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.083165 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.083310 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.083456 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.083703 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.084397 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.084568 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.084724 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.084872 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.085047 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.085201 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.085359 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.085507 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.085648 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.085789 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.085935 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.086083 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.086234 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.086392 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.086538 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.086684 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.086834 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.11 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.086981 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.087133 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.11 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.087282 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.087425 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.087575 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.087725 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.087904 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.088071 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.088215 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.088362 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.088511 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.088652 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.088853 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.089009 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.089198 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.089354 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.089502 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.089644 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.089792 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.089942 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.090100 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.090249 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.090398 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.090553 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.090702 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.090849 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.090990 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.091137 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.091279 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.091434 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.091599 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.091896 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.092065 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.11 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.092219 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.092361 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.11 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.092512 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.092653 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.092794 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.092939 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.093088 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.093228 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.093377 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.093377 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.093659 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.093801 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.093954 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.094108 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.094258 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.094406 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.094548 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.094696 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.094837 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.094990 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.095143 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.095285 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.095432 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.095582 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.095730 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.096465 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.096645 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.096790 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.096939 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.097080 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.097257 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.097408 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.097550 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.097693 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.097842 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.098032 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.098175 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.098329 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.098483 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.098624 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.098776 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.098917 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.099058 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.099218 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.099372 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.099521 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.099676 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.099845 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.099845 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.100138 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.100138 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.100430 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.100573 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.100720 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.100720 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.101004 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.101162 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.101311 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.101459 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.101600 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.101748 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.102999 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.103170 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.103327 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.103484 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.103633 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.103795 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.104001 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.104001 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.104273 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.104422 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.104572 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.104721 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.104872 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.105024 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.105166 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.105363 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.105522 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.105664 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.105804 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.105950 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.106099 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.106254 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.106403 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.106545 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.106685 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.106685 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.106949 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.107100 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.107242 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.107400 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.107543 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.107683 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.107851 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.108000 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.108141 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.108292 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.108433 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.108433 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.108709 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.108858 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.108999 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.109159 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.109310 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.109461 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.109612 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.109755 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.109902 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.110050 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.110191 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.110396 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.110540 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.110681 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.110821 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.110962 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.111112 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.111262 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.111412 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.111553 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.111701 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.111871 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.112125 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.112285 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.112436 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.112578 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.112726 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.112874 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.113015 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.113174 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:51:05.113350 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.113516 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.113667 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.113809 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.113972 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.114121 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.114263 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.114410 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.114552 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.114692 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.114850 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.114850 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.115137 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.115277 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.115427 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.115427 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.115710 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.115885 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.116043 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.116193 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.116342 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.116490 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.116634 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.116783 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.116934 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.117083 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.117232 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.117373 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.117514 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.117669 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.117811 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.117952 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.118093 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.118233 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.118382 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.118531 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.118682 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.118831 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.118998 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.119181 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.119339 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.119482 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.119623 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.119771 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.120004 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.120147 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.120296 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.120445 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.120587 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.120739 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.120888 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.120888 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.121176 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.121356 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.121507 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.121662 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.121813 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.121955 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.122125 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.122345 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.122499 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.122972 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.123129 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.123281 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.123433 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.123576 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.123723 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.123887 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.124034 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.124187 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.124330 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.124479 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.124620 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.124761 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.124911 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.125078 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.125221 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.125369 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.125519 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.125661 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.125809 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.125960 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.126113 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.126263 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.126405 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.126554 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.126713 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.126876 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.127020 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.127172 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.127314 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.128024 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.128194 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.128589 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.128739 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.128891 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.129043 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.129195 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.129349 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.129492 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.129651 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.129794 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.129934 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.130074 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.130225 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.130375 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.131020 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.131170 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.131321 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.131476 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.131618 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.131758 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.131758 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.132073 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.132215 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.132388 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.132612 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.132913 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.133058 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.133207 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.133367 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.133520 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.133670 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.133813 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.133960 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.134102 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.134262 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.134415 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.134557 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.134706 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.134706 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.134989 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.135161 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.135902 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.136071 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.136228 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.136372 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.136516 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.136516 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.136807 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.136956 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.137107 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.137256 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.137440 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.137603 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.137747 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.137896 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.138043 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.138191 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.138340 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.138562 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.138719 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.138719 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.139002 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.139151 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.139307 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.139448 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.139595 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.139745 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.139922 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.140067 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.140221 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.140364 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.140515 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.140675 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.140818 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.140958 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.141112 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.141262 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.141404 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.141544 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.141691 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.141834 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.141983 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.142210 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.142366 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.142516 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.142772 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.142960 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.143115 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.143271 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.143425 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.143567 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.143733 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.144016 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.144181 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.144326 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.144475 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.144618 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.144770 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.144927 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.145070 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.145070 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.145346 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.145487 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.145639 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.145794 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.145936 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.146098 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.146777 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.146920 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.147076 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.147236 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.147386 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.147534 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.147675 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.147885 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.148048 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.148200 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.148350 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.148492 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.148632 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.148781 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.148931 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.149075 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.149233 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.149377 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.149377 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.149377 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.149377 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.149377 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.149377 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.149377 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.149377 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.150949 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.150949 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.150949 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.150949 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.151762 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.152015 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.152237 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.152397 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.152528 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.152528 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.152773 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.152977 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.153103 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.153231 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.153231 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.153231 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.153231 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.153850 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.153850 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.154275 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.154492 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.154748 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.154957 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.154957 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.155362 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.155573 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.155749 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.155941 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.155941 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.156172 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.156607 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.156741 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.157062 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.157200 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.157554 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.157796 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.158007 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.158398 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.158539 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.158855 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.159022 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.159302 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.159634 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.160029 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.160483 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.160772 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.161111 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.161380 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.161741 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.162119 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.162270 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.162449 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.162672 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.162900 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.163271 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.163476 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.163691 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.163935 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.164210 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.164423 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.164648 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.164648 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.165098 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.165420 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.165607 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.165725 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.165837 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.165955 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.165955 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.165955 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.166326 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.166498 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.166837 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.167107 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.167248 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.167484 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.167754 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.167923 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.168154 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.168284 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.168481 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.168734 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.168867 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.169106 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.169265 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.169428 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.169660 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.169805 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.170099 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.170257 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.170415 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.170583 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.170749 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.171076 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.171233 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.171467 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.171607 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.172068 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.172304 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.172451 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.172649 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.172785 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.172984 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.173231 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.173388 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.173626 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.173757 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.174006 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.174139 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.174336 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.174554 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.174686 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.174975 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.175124 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.175311 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.175509 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.175649 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.175977 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.176123 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.176304 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.176476 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.176609 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.176911 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.177044 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.177249 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.177937 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.178305 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.178461 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.178716 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.179044 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.179176 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.179377 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.179593 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.179738 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.180055 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.180188 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.180404 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.180537 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.180746 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.181012 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.181162 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.181377 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.181612 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.181752 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.181890 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.182027 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.182305 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.182461 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.182630 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.182808 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.182949 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.183324 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.183464 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.183594 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.183750 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.183917 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.184207 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.184346 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.184524 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.184694 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.184872 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.185135 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.185290 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.185569 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.185720 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.185864 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.186022 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.186154 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.186435 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.186563 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.186771 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.186917 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.187289 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.187424 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.187614 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.187753 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.188032 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.188233 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.188374 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.188665 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.188797 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.189008 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.189147 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.189536 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.189669 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.189905 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.190046 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.190344 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.190509 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.190670 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.190859 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.191000 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.191317 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.191451 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.191689 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.191860 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.191992 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.192260 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.192415 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.192602 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.192747 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.194036 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.194186 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.194328 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.194328 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.194572 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.194699 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.194826 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.194961 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.195207 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.195358 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.195496 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.195738 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.195925 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.196172 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.196358 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.196498 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.196673 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.196804 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.197057 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.197202 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.197376 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.197591 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.197724 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.198013 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.198141 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.198329 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.198492 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.198664 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.198979 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.199126 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.199255 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.199451 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.199584 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.200047 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.200204 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.200364 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.200494 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.200631 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.200838 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.200976 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.201155 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.201368 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.201500 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.201737 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.201882 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.202121 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.202261 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.202418 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.202643 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.202784 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.203043 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.203181 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.203359 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.203542 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.203687 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.203996 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.204142 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.204372 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.204514 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.204652 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.204900 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.205033 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.205318 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.205461 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.205626 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.205877 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.206029 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.206213 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.206419 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.206558 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.206718 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.206861 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.207112 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.207245 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.207424 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.207639 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.207772 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.208107 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.208239 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.208397 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.208623 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.208812 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.209058 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.209276 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.209509 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.209649 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.209959 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.210305 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.210305 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.210572 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.210806 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.210944 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.211243 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.211395 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.211607 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.211739 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.211947 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.212174 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.212397 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.212601 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.212815 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.213029 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.213161 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.213458 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.213590 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.213788 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.213943 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.214151 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.214371 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.214503 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.214733 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.214875 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.215056 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.215279 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.215423 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.215704 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.215858 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.216110 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.216450 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.216618 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.216755 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.216882 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.217031 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.217274 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.217406 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.217660 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.217797 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.217982 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.218170 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.218318 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.218599 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.218738 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.218922 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.219060 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.219247 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.219495 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.219627 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.219906 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.220042 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.220385 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.220545 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.220683 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.220839 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.220977 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.221166 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.221315 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.222167 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.222318 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.222451 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.222677 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.222818 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.222956 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.223096 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.223096 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.223355 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.223494 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.223494 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.223737 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.223894 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.224033 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.224206 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.224475 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.224734 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.224879 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.225011 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.225139 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.225382 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.225516 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.225731 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.225889 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.226020 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.226372 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.226520 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.226726 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.226864 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.227003 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.227175 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.227375 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.227607 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.227740 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.228032 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.228183 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.228358 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.228531 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.228671 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.228960 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.229102 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.229281 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.229464 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.229602 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.229898 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.230033 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.230217 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.230561 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.230705 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.230944 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.231084 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.231220 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.231358 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.231487 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.231777 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.231951 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.232281 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.232432 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.232575 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.232864 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.232999 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.233127 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.233263 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.233521 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.233663 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.233897 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.234035 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.234232 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.234456 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.234607 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.234861 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.235000 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.235183 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.235347 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.235508 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.235876 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.236020 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.236191 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.236330 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.236575 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.236729 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.236938 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.237142 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.237275 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.237456 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.237586 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.237789 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.238008 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.238152 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.238434 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.238564 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.238861 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.239006 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.239195 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.239356 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.239517 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.239787 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.240815 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.240967 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.241106 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.241106 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.241357 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.241486 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.241651 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.241792 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.241954 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.242127 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.242259 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.245423 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.245607 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.245758 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.245941 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.246152 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.246296 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.246426 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.246693 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.247061 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.247198 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.247334 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.247462 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.247596 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.247745 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.247892 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.248022 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.248162 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.248291 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.248426 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.248564 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.248703 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.248703 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.248954 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.249088 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.249229 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.249366 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.249366 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.249614 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.249744 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.249870 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.250006 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.250006 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.250258 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.250391 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.250520 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.250670 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.250670 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.251155 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.251299 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.251584 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.251793 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.251793 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.252077 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.252207 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.252207 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.252469 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.252680 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.252813 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.252942 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.253069 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.253196 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.253196 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.253697 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.253828 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.253828 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.254070 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.254205 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.254340 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.254482 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.254482 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.254725 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.254860 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.254860 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.255121 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.255257 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.255257 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.256352 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.256498 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.256498 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.256766 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.256940 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.257237 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.257371 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.257371 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.257686 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.257823 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.257952 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.258089 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.258089 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.258339 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.258476 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.258615 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.258743 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.258743 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.258991 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.259126 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.259352 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.259535 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.259691 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.260007 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.260141 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.260379 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.260520 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.260709 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.261073 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.261224 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.261362 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.261499 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.261667 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.262040 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.262267 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.262418 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.262549 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.262689 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.262897 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.263066 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.263204 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.263334 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.263974 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.264214 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.264366 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.264503 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.264639 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.264775 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.264903 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.265095 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.265279 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.265412 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.265593 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.265817 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.266026 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.266169 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.273036 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.273258 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.273421 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.273559 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.273704 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.273857 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.273989 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.274132 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.274270 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.274401 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.274543 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.274674 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.274801 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.274931 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.275059 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.275194 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.275332 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.275462 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.275589 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.275725 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.276011 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.276147 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.276351 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.276483 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.276620 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.276749 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.276900 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.277266 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.277409 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.277539 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.277674 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.277816 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.277946 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.277946 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.278236 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.278365 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.278492 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.278628 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.278628 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.278895 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.279594 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.279594 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.279949 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.280088 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.280088 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.280352 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.280488 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.280625 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.280762 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.280762 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.281026 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.281157 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.281285 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.281420 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.281420 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.281662 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.281799 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.281928 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.288345 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.289140 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.289298 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.289298 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.289557 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.289697 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.289845 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.289983 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.289983 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.290254 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.290391 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.290527 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.290657 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.290792 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.290932 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.290932 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.291184 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.291313 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.291448 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.291584 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.291584 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.291862 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.291992 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.291992 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.292427 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.292582 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.292715 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.292843 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.292843 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.293092 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.293092 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.293352 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.293481 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.293608 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.293734 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.293857 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.293968 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.294088 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.294201 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.294201 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.294407 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.294516 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.294639 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.294765 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.294878 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.294989 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.295080 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.295171 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.295271 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.295369 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.295460 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.295544 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.295677 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.295769 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.295898 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.296009 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.296103 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.296199 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.296291 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.296375 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.296375 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.296555 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.296555 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.296889 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.296889 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.297073 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.297170 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.297254 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.297343 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.297428 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.297517 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.297614 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.297614 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.297774 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.297868 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.297952 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.298065 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.298161 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.298251 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.298566 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.298662 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.298662 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.298814 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.298910 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.299004 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.299095 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.299185 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.299269 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.299364 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.299448 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.299538 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.299627 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.299710 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.299791 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.299791 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.300047 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.300134 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.300216 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.300299 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.300380 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.300471 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.300561 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.300652 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.300736 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.300825 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.300910 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.301005 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.301091 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.301173 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.301261 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.301345 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.301435 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.301520 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.301610 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.301701 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.301785 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.301900 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.302083 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.302185 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.302278 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.302918 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.302918 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.302918 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.302918 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.302918 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.302918 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.302918 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.303456 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.303548 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.303863 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.304201 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.304337 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.304530 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.304832 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.304980 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.305171 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.305349 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.305481 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.305809 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.305938 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.306137 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.306310 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.306467 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.306831 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.306982 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.307126 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.307428 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.307568 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.307783 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.307966 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.308141 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.308469 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.308708 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.308849 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.309104 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.309246 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.309425 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.309620 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.309754 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.310059 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.310225 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.310385 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.310598 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.310730 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.310979 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.311159 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.311355 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.311494 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.311675 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.311973 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.312168 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.312421 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.312563 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.312816 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.312960 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.313149 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.313444 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.313578 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.313828 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.313980 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.314118 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.314390 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.314523 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.314747 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.314904 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.315079 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.315357 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.315527 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.315737 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.315896 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.316113 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.316328 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.316461 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.316752 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.317032 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.317157 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.317373 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.317696 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.317838 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.318779 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.318926 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.319056 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.319257 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.319443 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.319596 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.319953 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.320095 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.320288 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.320500 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.320632 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.320890 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.321033 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.321253 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.321393 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.321580 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.321827 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.321967 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.322233 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.322438 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.322584 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.322863 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.322994 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.323325 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.323470 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.323601 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.323798 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.324042 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.324189 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.324384 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.324524 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.324808 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.324949 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.325127 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.325337 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.325468 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.325769 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.325913 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.326101 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.326272 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.326418 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.326711 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.326842 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.327131 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.327367 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.327601 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.327743 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.328027 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.328175 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.328352 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.328626 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.329034 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.329179 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.329317 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.329317 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.329639 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.329781 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.329972 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.330145 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.330309 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.330581 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.330728 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.330978 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.331117 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.331335 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.331490 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.331676 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.331947 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.332082 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.332351 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.332482 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.332668 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.332892 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.333044 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 21 13:51:05.333386 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.333806 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.334198 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.334589 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.334970 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.335359 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.335740 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.336178 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.336564 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.336950 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.337441 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.337835 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.338217 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.338663 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.338983 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.339487 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.339908 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.340292 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.340681 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.341062 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.341462 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.341844 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.342232 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.342612 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.343018 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.343482 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.343927 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.344337 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.344727 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.345125 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.345513 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.345900 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.346325 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.346734 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.347459 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.347948 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.348351 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.348770 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.349209 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.349723 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.350112 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.351558 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.354704 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.354704 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.354704 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.354704 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.354704 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.354704 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.354704 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.354704 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.355718 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.355896 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.356217 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.356512 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_db.sqlalchemy.engines [None req-2cdc7ae6-7db0-44f8-b03a-d7063633466d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122565) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 13:51:05.356849 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.357089 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.357639 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.358038 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.358438 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.358830 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.359221 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.359781 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.360197 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.361938 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.361938 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.361938 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.361938 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.362491 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.362779 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.363042 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.363441 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.363999 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.364400 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.365325 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.365753 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.366160 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.366548 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.366958 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.367350 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.367888 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.368211 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.368494 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.368814 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.369222 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.369613 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.369888 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.370136 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.370460 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.370792 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.371114 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.371446 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.371766 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.372128 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.372460 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.372787 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.373108 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.373456 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.373780 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.374118 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.374438 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.374808 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.375071 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.375389 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.375722 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.376102 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.376418 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.376749 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.377071 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.377396 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.377748 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.378064 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.378655 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.378975 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.379319 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.379687 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.379946 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.380262 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.381224 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.381564 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.381899 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.382233 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.382570 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.382967 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.383242 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.383603 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.383962 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.384285 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.384604 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.384917 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:51:05.385159 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 21 13:51:05.407875 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_db.sqlalchemy.engines [None req-97b6905e-7495-4f3b-8b9c-0360a905a87d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 13:51:05.518705 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.context [None req-2cdc7ae6-7db0-44f8-b03a-d7063633466d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),da1f9230-ca05-4575-ad3a-5b14aaa593ab(cell1) {{(pid=122565) load_cells /opt/stack/nova/nova/context.py:464}} Nov 21 13:51:05.523594 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2cdc7ae6-7db0-44f8-b03a-d7063633466d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:51:05.525391 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2cdc7ae6-7db0-44f8-b03a-d7063633466d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:51:05.526335 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2cdc7ae6-7db0-44f8-b03a-d7063633466d None None] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:51:05.528443 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2cdc7ae6-7db0-44f8-b03a-d7063633466d None None] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:51:05.540347 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_db.sqlalchemy.engines [None req-2cdc7ae6-7db0-44f8-b03a-d7063633466d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122565) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 13:51:05.541324 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_db.sqlalchemy.engines [None req-2cdc7ae6-7db0-44f8-b03a-d7063633466d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122565) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 13:51:05.567561 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.context [None req-97b6905e-7495-4f3b-8b9c-0360a905a87d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),da1f9230-ca05-4575-ad3a-5b14aaa593ab(cell1) {{(pid=122564) load_cells /opt/stack/nova/nova/context.py:464}} Nov 21 13:51:05.572068 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-97b6905e-7495-4f3b-8b9c-0360a905a87d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:51:05.573682 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-97b6905e-7495-4f3b-8b9c-0360a905a87d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:51:05.574507 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-97b6905e-7495-4f3b-8b9c-0360a905a87d None None] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:51:05.576484 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-97b6905e-7495-4f3b-8b9c-0360a905a87d None None] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:51:05.587216 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_db.sqlalchemy.engines [None req-97b6905e-7495-4f3b-8b9c-0360a905a87d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 13:51:05.588224 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_db.sqlalchemy.engines [None req-97b6905e-7495-4f3b-8b9c-0360a905a87d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 13:51:05.701047 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_db.sqlalchemy.engines [None req-2cdc7ae6-7db0-44f8-b03a-d7063633466d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122565) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 13:51:05.747827 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_db.sqlalchemy.engines [None req-97b6905e-7495-4f3b-8b9c-0360a905a87d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 13:51:06.026766 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: WARNING keystonemiddleware.auth_token [None req-2cdc7ae6-7db0-44f8-b03a-d7063633466d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 13:51:06.033352 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: WARNING keystonemiddleware.auth_token [None req-2cdc7ae6-7db0-44f8-b03a-d7063633466d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 13:51:06.077150 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: WARNING keystonemiddleware.auth_token [None req-97b6905e-7495-4f3b-8b9c-0360a905a87d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 13:51:06.084309 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: WARNING keystonemiddleware.auth_token [None req-97b6905e-7495-4f3b-8b9c-0360a905a87d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 13:51:06.384518 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: WARNING keystonemiddleware.auth_token [None req-2cdc7ae6-7db0-44f8-b03a-d7063633466d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 13:51:06.390464 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: WARNING keystonemiddleware.auth_token [None req-2cdc7ae6-7db0-44f8-b03a-d7063633466d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 13:51:06.396590 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5591d09bd9c0 pid: 122565 (default app) Nov 21 13:51:06.432994 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: WARNING keystonemiddleware.auth_token [None req-97b6905e-7495-4f3b-8b9c-0360a905a87d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 13:51:06.438239 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: WARNING keystonemiddleware.auth_token [None req-97b6905e-7495-4f3b-8b9c-0360a905a87d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 13:51:06.443667 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5591d09bd9c0 pid: 122564 (default app) Nov 21 13:51:41.062768 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-7918f3a6-158d-4934-9598-b90d45d76fa3 tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] Action: 'create', calling method: .version_select at 0x7fd521c214c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-677606932", "metadata": {"Type": "work"}}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:51:41.074490 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-7918f3a6-158d-4934-9598-b90d45d76fa3 tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:51:41.074490 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-7918f3a6-158d-4934-9598-b90d45d76fa3 tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] 10.222.0.11 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.967413 Nov 21 13:51:41.074490 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 1/1] 10.222.0.11 () {60 vars in 1155 bytes} [Sun Nov 21 13:51:40 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 971 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 21 13:51:41.121127 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-80c3eac8-ef6d-4543-84f5-db686cc2a3cd tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] Action: 'create', calling method: .version_select at 0x7fd521c1e4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-488664450"}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:51:41.165782 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-557068652", "imageRef": "acdb574e-2ba9-4029-849b-377b4d5722ce", "flavorRef": "452", "networks": [{"uuid": "329f6f8a-93b1-430a-8c57-dacb018278ff"}]}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:51:41.712839 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.network.neutron [None req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] validate_networks() for [('329f6f8a-93b1-430a-8c57-dacb018278ff', None, None, None, None, None)] {{(pid=122564) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 21 13:51:42.519466 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-80c3eac8-ef6d-4543-84f5-db686cc2a3cd tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] 10.222.0.11 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.023902 Nov 21 13:51:42.520657 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 1/2] 10.222.0.11 () {60 vars in 1154 bytes} [Sun Nov 21 13:51:39 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 3026 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 21 13:51:42.525549 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-f29b7cd5-ca34-44c2-bbe8-ea73ed68840d tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] Action: 'create', calling method: .version_select at 0x7fd521be50d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2080389746", "metadata": {"Type": "work"}}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:51:42.532694 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-f29b7cd5-ca34-44c2-bbe8-ea73ed68840d tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:51:42.533799 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-f29b7cd5-ca34-44c2-bbe8-ea73ed68840d tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] 10.222.0.11 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012167 Nov 21 13:51:42.534524 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 2/3] 10.222.0.11 () {60 vars in 1155 bytes} [Sun Nov 21 13:51:42 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 21 13:51:42.544255 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-b2711a4c-c95c-4915-9b58-f6f25e0d33ec tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] Calling method '.version_select at 0x7fd5224c3af0>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:42.655343 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-b2711a4c-c95c-4915-9b58-f6f25e0d33ec tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/69a93b28-dd35-42f1-9111-bc7365766610" status: 200 len: 344 microversion: 2.1 time: 0.114405 Nov 21 13:51:42.656066 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 3/4] 10.222.0.11 () {58 vars in 1244 bytes} [Sun Nov 21 13:51:42 2021] GET /compute/v2.1/os-volumes/69a93b28-dd35-42f1-9111-bc7365766610 => generated 344 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:51:42.661698 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-6e82824c-10fe-4248-bfb5-fff833861360 tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] Action: 'create', calling method: .version_select at 0x7fd521aea1f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1535514535", "metadata": {"Type": "work"}}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:51:42.663166 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-6e82824c-10fe-4248-bfb5-fff833861360 tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:51:42.664155 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-6e82824c-10fe-4248-bfb5-fff833861360 tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] 10.222.0.11 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006563 Nov 21 13:51:42.664753 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 4/5] 10.222.0.11 () {60 vars in 1155 bytes} [Sun Nov 21 13:51:42 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 21 13:51:42.681114 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-b8d0d7bb-de83-4398-8426-c77d285e1f59 tempest-VolumesTestJSON-615491074 tempest-VolumesTestJSON-615491074-project] Calling method '.version_select at 0x7fd521afc550>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:42.764851 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-b8d0d7bb-de83-4398-8426-c77d285e1f59 tempest-VolumesTestJSON-615491074 tempest-VolumesTestJSON-615491074-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/433d4dfb-695f-4cb8-bc25-79ae88731102" status: 200 len: 351 microversion: 2.1 time: 0.090821 Nov 21 13:51:42.765693 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 5/6] 10.222.0.11 () {58 vars in 1244 bytes} [Sun Nov 21 13:51:42 2021] GET /compute/v2.1/os-volumes/433d4dfb-695f-4cb8-bc25-79ae88731102 => generated 351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:51:42.773047 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-011582e3-fea7-40c6-97f8-223739060276 tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] Calling method '.version_select at 0x7fd521aeae50>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:42.830073 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-011582e3-fea7-40c6-97f8-223739060276 tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] HTTP exception thrown: Volume tempest-invalid-2000882987 could not be found. Nov 21 13:51:42.836009 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-011582e3-fea7-40c6-97f8-223739060276 tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] Returning 404 to user: Volume tempest-invalid-2000882987 could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:51:42.838434 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-011582e3-fea7-40c6-97f8-223739060276 tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] 10.222.0.11 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2000882987" status: 404 len: 99 microversion: 2.1 time: 0.070526 Nov 21 13:51:42.847199 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 6/7] 10.222.0.11 () {58 vars in 1217 bytes} [Sun Nov 21 13:51:42 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-2000882987 => generated 99 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 21 13:51:42.854056 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-52576563-d7d6-4eea-8e87-de0e21370ede tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] 10.222.0.11 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005323 Nov 21 13:51:42.860600 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 7/8] 10.222.0.11 () {58 vars in 1139 bytes} [Sun Nov 21 13:51:42 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 21 13:51:42.866901 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-9e040b6d-ed7b-4501-b944-e5aec80bdbf6 tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004912 Nov 21 13:51:42.875013 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 8/9] 10.222.0.11 () {58 vars in 1136 bytes} [Sun Nov 21 13:51:42 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 21 13:51:42.882361 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-92967c68-b0aa-4c8d-8acf-073602ae5ebd tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] Calling method '.version_select at 0x7fd521aea790>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:42.922720 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-92967c68-b0aa-4c8d-8acf-073602ae5ebd tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] HTTP exception thrown: Volume 92af2a00-03ea-4546-9c06-ad8c66a7caac could not be found. Nov 21 13:51:42.923484 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-92967c68-b0aa-4c8d-8acf-073602ae5ebd tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] Returning 404 to user: Volume 92af2a00-03ea-4546-9c06-ad8c66a7caac could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:51:42.925091 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-92967c68-b0aa-4c8d-8acf-073602ae5ebd tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] 10.222.0.11 "DELETE /compute/v2.1/os-volumes/92af2a00-03ea-4546-9c06-ad8c66a7caac" status: 404 len: 109 microversion: 2.1 time: 0.048526 Nov 21 13:51:42.925717 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 9/10] 10.222.0.11 () {58 vars in 1247 bytes} [Sun Nov 21 13:51:42 2021] DELETE /compute/v2.1/os-volumes/92af2a00-03ea-4546-9c06-ad8c66a7caac => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:51:42.934616 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-060dcc3e-c16d-44c8-90c4-714af11faeb4 tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] Calling method '.version_select at 0x7fd5224c3ca0>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:42.982184 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-060dcc3e-c16d-44c8-90c4-714af11faeb4 tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] HTTP exception thrown: Volume 87ffdb86-4f21-4425-a1e4-157005ad2e3b could not be found. Nov 21 13:51:42.982875 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-060dcc3e-c16d-44c8-90c4-714af11faeb4 tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] Returning 404 to user: Volume 87ffdb86-4f21-4425-a1e4-157005ad2e3b could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:51:42.983772 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-060dcc3e-c16d-44c8-90c4-714af11faeb4 tempest-VolumesNegativeTest-597574055 tempest-VolumesNegativeTest-597574055-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/87ffdb86-4f21-4425-a1e4-157005ad2e3b" status: 404 len: 109 microversion: 2.1 time: 0.052702 Nov 21 13:51:42.984633 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 10/11] 10.222.0.11 () {58 vars in 1244 bytes} [Sun Nov 21 13:51:42 2021] GET /compute/v2.1/os-volumes/87ffdb86-4f21-4425-a1e4-157005ad2e3b => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:51:43.667760 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-3db57b4f-8dcb-4bda-be21-2c86cb054967 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] Calling method '.version_select at 0x7fd521aea790>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:43.818079 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-3db57b4f-8dcb-4bda-be21-2c86cb054967 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/69a93b28-dd35-42f1-9111-bc7365766610" status: 200 len: 345 microversion: 2.1 time: 0.153807 Nov 21 13:51:43.823876 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 11/12] 10.222.0.11 () {58 vars in 1244 bytes} [Sun Nov 21 13:51:43 2021] GET /compute/v2.1/os-volumes/69a93b28-dd35-42f1-9111-bc7365766610 => generated 345 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:51:43.830579 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-364a5897-e387-4505-9ca1-24c29cee6708 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] Action: 'create', calling method: .version_select at 0x7fd521afc430>, body: {"snapshot": {"volume_id": "69a93b28-dd35-42f1-9111-bc7365766610", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1901651832"}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:51:44.363669 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-364a5897-e387-4505-9ca1-24c29cee6708 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] 10.222.0.11 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.537011 Nov 21 13:51:44.364552 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 12/13] 10.222.0.11 () {60 vars in 1161 bytes} [Sun Nov 21 13:51:43 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:51:44.375461 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ca55d896-c3ef-48e3-9514-bf13e2e6324e tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] Calling method '.version_select at 0x7fd521aea0d0>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:44.454702 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Flavor limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 13:51:44.455378 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Image limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 13:51:44.455767 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Flavor pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 13:51:44.456595 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Image pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 13:51:44.457214 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 13:51:44.493089 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:51:44.493773 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:51:44.494978 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:51:44.495610 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:51:44.539691 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ca55d896-c3ef-48e3-9514-bf13e2e6324e tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/5a2ccfd1-62ab-4cde-8277-684f9e5fd43f" status: 200 len: 287 microversion: 2.1 time: 0.169190 Nov 21 13:51:44.540315 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 13/14] 10.222.0.11 () {58 vars in 1250 bytes} [Sun Nov 21 13:51:44 2021] GET /compute/v2.1/os-snapshots/5a2ccfd1-62ab-4cde-8277-684f9e5fd43f => generated 287 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:51:44.552580 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-28c1b64a-4a99-47fc-8813-ae3f3d59a92d tempest-VolumesTestJSON-615491074 tempest-VolumesTestJSON-615491074-project] Calling method '.version_select at 0x7fd521aeac10>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:44.573243 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Getting quotas for project 9580a66e32944e649fafe038a1d4cc4a. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:51:44.584404 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Getting quotas for user c5dded159cfd4b48bacae751b36f0ec0 and project 9580a66e32944e649fafe038a1d4cc4a. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:51:44.620388 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Going to run 1 instances... {{(pid=122564) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 13:51:44.622257 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-28c1b64a-4a99-47fc-8813-ae3f3d59a92d tempest-VolumesTestJSON-615491074 tempest-VolumesTestJSON-615491074-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/e6dd9b00-64e4-4fcf-b748-60ec07542844" status: 200 len: 351 microversion: 2.1 time: 0.074272 Nov 21 13:51:44.623046 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 14/15] 10.222.0.11 () {58 vars in 1244 bytes} [Sun Nov 21 13:51:44 2021] GET /compute/v2.1/os-volumes/e6dd9b00-64e4-4fcf-b748-60ec07542844 => generated 351 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:51:44.624122 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='acdb574e-2ba9-4029-849b-377b4d5722ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 13:51:44.628588 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-705a4df0-280c-4e98-9700-b2abf2d89358 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] Calling method '.version_select at 0x7fd521afc670>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:44.741779 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-705a4df0-280c-4e98-9700-b2abf2d89358 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.116767 Nov 21 13:51:44.748496 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 15/16] 10.222.0.11 () {58 vars in 1139 bytes} [Sun Nov 21 13:51:44 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:51:44.753419 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c23ee2b9-0d0e-4888-9223-bd8dfe5b7e29 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] Calling method '.version_select at 0x7fd521afc4c0>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:44.807677 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.737987 Nov 21 13:51:44.808548 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 2/17] 10.222.0.11 () {60 vars in 1146 bytes} [Sun Nov 21 13:51:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 3739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 13:51:44.820193 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-aacd00c5-e729-4b09-9bfe-76a856645b9d tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:44.821241 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-aacd00c5-e729-4b09-9bfe-76a856645b9d tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:51:44.824927 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c23ee2b9-0d0e-4888-9223-bd8dfe5b7e29 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/5a2ccfd1-62ab-4cde-8277-684f9e5fd43f" status: 200 len: 287 microversion: 2.1 time: 0.074911 Nov 21 13:51:44.825944 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 16/18] 10.222.0.11 () {58 vars in 1250 bytes} [Sun Nov 21 13:51:44 2021] GET /compute/v2.1/os-snapshots/5a2ccfd1-62ab-4cde-8277-684f9e5fd43f => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:51:45.012849 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-aacd00c5-e729-4b09-9bfe-76a856645b9d tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:51:45.063610 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-aacd00c5-e729-4b09-9bfe-76a856645b9d tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1214 microversion: 2.1 time: 0.246773 Nov 21 13:51:45.064418 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 3/19] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:51:44 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1214 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:51:45.840465 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-9f2e856b-a83b-4d54-8356-c74204a4a4bb tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] Calling method '.version_select at 0x7fd521afcd30>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:45.925259 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-9f2e856b-a83b-4d54-8356-c74204a4a4bb tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/5a2ccfd1-62ab-4cde-8277-684f9e5fd43f" status: 200 len: 287 microversion: 2.1 time: 0.089505 Nov 21 13:51:45.931336 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 17/20] 10.222.0.11 () {58 vars in 1250 bytes} [Sun Nov 21 13:51:45 2021] GET /compute/v2.1/os-snapshots/5a2ccfd1-62ab-4cde-8277-684f9e5fd43f => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:51:46.086375 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-8efdc7b1-008c-42db-9610-42da225621e5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:46.087127 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-8efdc7b1-008c-42db-9610-42da225621e5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:51:46.238520 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-8efdc7b1-008c-42db-9610-42da225621e5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:51:46.253684 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-8efdc7b1-008c-42db-9610-42da225621e5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1214 microversion: 2.1 time: 0.174627 Nov 21 13:51:46.254787 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 4/21] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:51:46 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1214 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:51:46.937480 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-fac362e8-e8a1-483d-90f9-b1bd010397c1 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] Calling method '.version_select at 0x7fd521aeaca0>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:46.970020 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-fac362e8-e8a1-483d-90f9-b1bd010397c1 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/5a2ccfd1-62ab-4cde-8277-684f9e5fd43f" status: 200 len: 287 microversion: 2.1 time: 0.035789 Nov 21 13:51:46.976008 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 18/22] 10.222.0.11 () {58 vars in 1250 bytes} [Sun Nov 21 13:51:46 2021] GET /compute/v2.1/os-snapshots/5a2ccfd1-62ab-4cde-8277-684f9e5fd43f => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:51:47.274429 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-7305f776-9e6b-416d-b34f-dd443ef35c0b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:47.275104 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-7305f776-9e6b-416d-b34f-dd443ef35c0b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:51:47.287855 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7305f776-9e6b-416d-b34f-dd443ef35c0b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:51:47.287855 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7305f776-9e6b-416d-b34f-dd443ef35c0b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:51:47.287855 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7305f776-9e6b-416d-b34f-dd443ef35c0b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:51:47.287855 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7305f776-9e6b-416d-b34f-dd443ef35c0b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:51:47.743997 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-7305f776-9e6b-416d-b34f-dd443ef35c0b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:51:47.766749 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-7305f776-9e6b-416d-b34f-dd443ef35c0b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1218 microversion: 2.1 time: 0.499760 Nov 21 13:51:47.772108 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 5/23] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:51:47 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1218 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:51:47.989842 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-90776722-8ccb-4dcb-a6a5-db1c41f32209 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] Calling method '.version_select at 0x7fd521aea700>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:48.079988 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-90776722-8ccb-4dcb-a6a5-db1c41f32209 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/5a2ccfd1-62ab-4cde-8277-684f9e5fd43f" status: 200 len: 288 microversion: 2.1 time: 0.100784 Nov 21 13:51:48.085043 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 19/24] 10.222.0.11 () {58 vars in 1250 bytes} [Sun Nov 21 13:51:47 2021] GET /compute/v2.1/os-snapshots/5a2ccfd1-62ab-4cde-8277-684f9e5fd43f => generated 288 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:51:48.095742 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-bcf1b192-d482-4705-8c99-9e09fc6ba3b6 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] Calling method '.version_select at 0x7fd52095d0d0>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:48.245589 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-bcf1b192-d482-4705-8c99-9e09fc6ba3b6 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] 10.222.0.11 "DELETE /compute/v2.1/os-snapshots/5a2ccfd1-62ab-4cde-8277-684f9e5fd43f" status: 202 len: 0 microversion: 2.1 time: 0.153557 Nov 21 13:51:48.247599 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 6/25] 10.222.0.11 () {58 vars in 1253 bytes} [Sun Nov 21 13:51:48 2021] DELETE /compute/v2.1/os-snapshots/5a2ccfd1-62ab-4cde-8277-684f9e5fd43f => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:51:48.259902 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-9d6fb3c9-2b0c-415b-a7ad-84c4bd38eb9d tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] Calling method '.version_select at 0x7fd521aeab80>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:48.319549 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-9d6fb3c9-2b0c-415b-a7ad-84c4bd38eb9d tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/5a2ccfd1-62ab-4cde-8277-684f9e5fd43f" status: 200 len: 287 microversion: 2.1 time: 0.066968 Nov 21 13:51:48.320798 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 20/26] 10.222.0.11 () {58 vars in 1250 bytes} [Sun Nov 21 13:51:48 2021] GET /compute/v2.1/os-snapshots/5a2ccfd1-62ab-4cde-8277-684f9e5fd43f => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:51:48.559250 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-55194a6c-a533-4c03-9824-c9898162e4cc tempest-VolumesTestJSON-615491074 tempest-VolumesTestJSON-615491074-project] Calling method '.version_select at 0x7fd52095daf0>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:48.641586 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-55194a6c-a533-4c03-9824-c9898162e4cc tempest-VolumesTestJSON-615491074 tempest-VolumesTestJSON-615491074-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/5f995f3d-66da-43de-af43-9c79b40179f2" status: 200 len: 350 microversion: 2.1 time: 0.085727 Nov 21 13:51:48.642986 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 7/27] 10.222.0.11 () {58 vars in 1244 bytes} [Sun Nov 21 13:51:48 2021] GET /compute/v2.1/os-volumes/5f995f3d-66da-43de-af43-9c79b40179f2 => generated 350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:51:48.655356 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-5b526f72-a287-4b24-baf9-1e19e7473f39 tempest-VolumesTestJSON-615491074 tempest-VolumesTestJSON-615491074-project] Calling method '.version_select at 0x7fd521aeac10>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:48.788209 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-f4e56192-d971-4115-95f1-2e3d4612601f tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:48.789153 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-f4e56192-d971-4115-95f1-2e3d4612601f tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:51:48.800090 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f4e56192-d971-4115-95f1-2e3d4612601f tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:51:48.800793 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f4e56192-d971-4115-95f1-2e3d4612601f tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:51:48.802400 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f4e56192-d971-4115-95f1-2e3d4612601f tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:51:48.804596 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f4e56192-d971-4115-95f1-2e3d4612601f tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:51:48.877621 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-5b526f72-a287-4b24-baf9-1e19e7473f39 tempest-VolumesTestJSON-615491074 tempest-VolumesTestJSON-615491074-project] 10.222.0.11 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.226192 Nov 21 13:51:48.878498 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 21/28] 10.222.0.11 () {58 vars in 1133 bytes} [Sun Nov 21 13:51:48 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:51:48.891183 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-82ee77ce-3fa4-492f-a506-afc7893e1839 tempest-VolumesTestJSON-615491074 tempest-VolumesTestJSON-615491074-project] Calling method '.version_select at 0x7fd521afc280>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:48.998248 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-82ee77ce-3fa4-492f-a506-afc7893e1839 tempest-VolumesTestJSON-615491074 tempest-VolumesTestJSON-615491074-project] 10.222.0.11 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.110494 Nov 21 13:51:48.999981 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 22/29] 10.222.0.11 () {58 vars in 1148 bytes} [Sun Nov 21 13:51:48 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:51:49.011231 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-3612eeff-6856-4f08-84d7-4febb8e66f9c tempest-VolumesTestJSON-615491074 tempest-VolumesTestJSON-615491074-project] Calling method '.version_select at 0x7fd521afcdc0>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:49.157276 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-3612eeff-6856-4f08-84d7-4febb8e66f9c tempest-VolumesTestJSON-615491074 tempest-VolumesTestJSON-615491074-project] 10.222.0.11 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.149585 Nov 21 13:51:49.158493 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 23/30] 10.222.0.11 () {58 vars in 1133 bytes} [Sun Nov 21 13:51:49 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:51:49.169844 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-79374033-602f-44c0-aa2c-0a47a79ffa97 tempest-VolumesTestJSON-615491074 tempest-VolumesTestJSON-615491074-project] Calling method '.version_select at 0x7fd5224c3c10>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:49.408742 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-79374033-602f-44c0-aa2c-0a47a79ffa97 tempest-VolumesTestJSON-615491074 tempest-VolumesTestJSON-615491074-project] 10.222.0.11 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.241457 Nov 21 13:51:49.409746 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 24/31] 10.222.0.11 () {58 vars in 1166 bytes} [Sun Nov 21 13:51:49 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:51:49.417098 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-10257fbe-af6b-40f3-bd6b-2c97e6a4157b tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] Calling method '.version_select at 0x7fd521a960d0>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:49.429770 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-f4e56192-d971-4115-95f1-2e3d4612601f tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:51:49.468097 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-f4e56192-d971-4115-95f1-2e3d4612601f tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1266 microversion: 2.1 time: 0.682026 Nov 21 13:51:49.469303 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 8/32] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:51:48 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1266 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:51:49.486894 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-59582157-53ae-4a23-893a-023743817589 tempest-VolumesTestJSON-615491074 tempest-VolumesTestJSON-615491074-project] Calling method '.version_select at 0x7fd5208ff040>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:49.496239 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-10257fbe-af6b-40f3-bd6b-2c97e6a4157b tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] HTTP exception thrown: Snapshot 5a2ccfd1-62ab-4cde-8277-684f9e5fd43f could not be found. Nov 21 13:51:49.496892 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-10257fbe-af6b-40f3-bd6b-2c97e6a4157b tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] Returning 404 to user: Snapshot 5a2ccfd1-62ab-4cde-8277-684f9e5fd43f could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:51:49.498363 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-10257fbe-af6b-40f3-bd6b-2c97e6a4157b tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] 10.222.0.11 "GET /compute/v2.1/os-snapshots/5a2ccfd1-62ab-4cde-8277-684f9e5fd43f" status: 404 len: 111 microversion: 2.1 time: 0.087607 Nov 21 13:51:49.503947 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 25/33] 10.222.0.11 () {58 vars in 1250 bytes} [Sun Nov 21 13:51:49 2021] GET /compute/v2.1/os-snapshots/5a2ccfd1-62ab-4cde-8277-684f9e5fd43f => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:51:49.533333 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-befcbab7-a2c4-4b85-aa7e-befbaaaf3314 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] Calling method '.version_select at 0x7fd521aea9d0>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:49.713025 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-befcbab7-a2c4-4b85-aa7e-befbaaaf3314 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] 10.222.0.11 "DELETE /compute/v2.1/os-volumes/69a93b28-dd35-42f1-9111-bc7365766610" status: 202 len: 0 microversion: 2.1 time: 0.202276 Nov 21 13:51:49.713838 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 26/34] 10.222.0.11 () {58 vars in 1247 bytes} [Sun Nov 21 13:51:49 2021] DELETE /compute/v2.1/os-volumes/69a93b28-dd35-42f1-9111-bc7365766610 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:51:49.720834 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-59582157-53ae-4a23-893a-023743817589 tempest-VolumesTestJSON-615491074 tempest-VolumesTestJSON-615491074-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.250163 Nov 21 13:51:49.722542 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 9/35] 10.222.0.11 () {58 vars in 1169 bytes} [Sun Nov 21 13:51:49 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:51:49.722873 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-903bfd6c-b8cf-4751-ac1c-643980353250 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] Calling method '.version_select at 0x7fd5224c3c10>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:49.735648 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-bda68978-5bfd-4a03-b1f1-faa14eb384da tempest-VolumesTestJSON-615491074 tempest-VolumesTestJSON-615491074-project] Calling method '.version_select at 0x7fd520908700>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:49.851400 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-903bfd6c-b8cf-4751-ac1c-643980353250 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/69a93b28-dd35-42f1-9111-bc7365766610" status: 200 len: 344 microversion: 2.1 time: 0.133056 Nov 21 13:51:49.852399 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 27/36] 10.222.0.11 () {58 vars in 1244 bytes} [Sun Nov 21 13:51:49 2021] GET /compute/v2.1/os-volumes/69a93b28-dd35-42f1-9111-bc7365766610 => generated 344 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:51:49.950887 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-bda68978-5bfd-4a03-b1f1-faa14eb384da tempest-VolumesTestJSON-615491074 tempest-VolumesTestJSON-615491074-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.218445 Nov 21 13:51:49.950887 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 10/37] 10.222.0.11 () {58 vars in 1154 bytes} [Sun Nov 21 13:51:49 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:51:49.964207 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-4234321b-4a27-4e50-96fe-d6b7bf4672aa tempest-VolumesTestJSON-615491074 tempest-VolumesTestJSON-615491074-project] Calling method '.version_select at 0x7fd520908c10>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:50.113390 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-60ae8e07-e383-4d4a-adac-0af4a88c0265 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'create', calling method: .version_select at 0x7fd521aea820>, body: {"keypair": {"name": "tempest-keypair-1306439029"}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:51:50.162080 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-4234321b-4a27-4e50-96fe-d6b7bf4672aa tempest-VolumesTestJSON-615491074 tempest-VolumesTestJSON-615491074-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.201458 Nov 21 13:51:50.163233 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 11/38] 10.222.0.11 () {58 vars in 1187 bytes} [Sun Nov 21 13:51:49 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:51:50.175131 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-877bd693-8834-4b0d-b838-29c63fe52f3a tempest-VolumesTestJSON-615491074 tempest-VolumesTestJSON-615491074-project] Calling method '.version_select at 0x7fd5208ff1f0>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:50.226300 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-60ae8e07-e383-4d4a-adac-0af4a88c0265 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Getting quotas for project 389c281a19bb49e583633f57108f7f69. Resources: {'key_pairs'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:51:50.251423 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-60ae8e07-e383-4d4a-adac-0af4a88c0265 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Getting quotas for user 07abcb2febc44ec8a0a2493b53233a66 and project 389c281a19bb49e583633f57108f7f69. Resources: {'key_pairs'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:51:50.392658 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-877bd693-8834-4b0d-b838-29c63fe52f3a tempest-VolumesTestJSON-615491074 tempest-VolumesTestJSON-615491074-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.221774 Nov 21 13:51:50.393817 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 12/39] 10.222.0.11 () {58 vars in 1154 bytes} [Sun Nov 21 13:51:50 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:51:50.487135 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-895fc5d2-f8e2-47f0-973d-106a5139fa17 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:50.488292 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-895fc5d2-f8e2-47f0-973d-106a5139fa17 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:51:50.533645 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-895fc5d2-f8e2-47f0-973d-106a5139fa17 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:51:50.537674 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-895fc5d2-f8e2-47f0-973d-106a5139fa17 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:51:50.542336 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-895fc5d2-f8e2-47f0-973d-106a5139fa17 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:51:50.544748 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-895fc5d2-f8e2-47f0-973d-106a5139fa17 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:51:50.882296 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-895fc5d2-f8e2-47f0-973d-106a5139fa17 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:51:50.896834 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-895fc5d2-f8e2-47f0-973d-106a5139fa17 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1272 microversion: 2.1 time: 0.414048 Nov 21 13:51:50.902310 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 13/40] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:51:50 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1272 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:51:50.935919 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-7141376a-c749-4a8d-afca-9cc917d04d48 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] Calling method '.version_select at 0x7fd5208ff9d0>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:51.032516 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.wsgi [None req-7141376a-c749-4a8d-afca-9cc917d04d48 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] HTTP exception thrown: Volume 69a93b28-dd35-42f1-9111-bc7365766610 could not be found. Nov 21 13:51:51.033434 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-7141376a-c749-4a8d-afca-9cc917d04d48 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] Returning 404 to user: Volume 69a93b28-dd35-42f1-9111-bc7365766610 could not be found. {{(pid=122564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:51:51.034439 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-7141376a-c749-4a8d-afca-9cc917d04d48 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/69a93b28-dd35-42f1-9111-bc7365766610" status: 404 len: 109 microversion: 2.1 time: 0.130886 Nov 21 13:51:51.036143 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 14/41] 10.222.0.11 () {58 vars in 1244 bytes} [Sun Nov 21 13:51:50 2021] GET /compute/v2.1/os-volumes/69a93b28-dd35-42f1-9111-bc7365766610 => generated 109 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:51:51.051149 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2f8562c7-a9de-4437-b768-dff556dfcb61 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] Calling method '.version_select at 0x7fd5208ff280>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:51.100207 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.wsgi [None req-2f8562c7-a9de-4437-b768-dff556dfcb61 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] HTTP exception thrown: Volume 69a93b28-dd35-42f1-9111-bc7365766610 could not be found. Nov 21 13:51:51.101049 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2f8562c7-a9de-4437-b768-dff556dfcb61 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] Returning 404 to user: Volume 69a93b28-dd35-42f1-9111-bc7365766610 could not be found. {{(pid=122564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:51:51.102070 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-2f8562c7-a9de-4437-b768-dff556dfcb61 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] 10.222.0.11 "DELETE /compute/v2.1/os-volumes/69a93b28-dd35-42f1-9111-bc7365766610" status: 404 len: 109 microversion: 2.1 time: 0.056156 Nov 21 13:51:51.111129 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 15/42] 10.222.0.11 () {58 vars in 1247 bytes} [Sun Nov 21 13:51:51 2021] DELETE /compute/v2.1/os-volumes/69a93b28-dd35-42f1-9111-bc7365766610 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:51:51.149511 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-d498b7b5-e4b9-4d08-8b52-36c431d56d86 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] Calling method '.version_select at 0x7fd5208dff70>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:51.250005 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.wsgi [None req-d498b7b5-e4b9-4d08-8b52-36c431d56d86 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] HTTP exception thrown: Volume 69a93b28-dd35-42f1-9111-bc7365766610 could not be found. Nov 21 13:51:51.250927 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-d498b7b5-e4b9-4d08-8b52-36c431d56d86 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] Returning 404 to user: Volume 69a93b28-dd35-42f1-9111-bc7365766610 could not be found. {{(pid=122564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:51:51.252237 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-d498b7b5-e4b9-4d08-8b52-36c431d56d86 tempest-VolumesSnapshotsTestJSON-472456979 tempest-VolumesSnapshotsTestJSON-472456979-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/69a93b28-dd35-42f1-9111-bc7365766610" status: 404 len: 109 microversion: 2.1 time: 0.136473 Nov 21 13:51:51.253169 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 16/43] 10.222.0.11 () {58 vars in 1244 bytes} [Sun Nov 21 13:51:51 2021] GET /compute/v2.1/os-volumes/69a93b28-dd35-42f1-9111-bc7365766610 => generated 109 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:51:51.919457 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-8b25fc35-f004-4cc1-ac70-26c1cd86330f tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:51.920947 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-8b25fc35-f004-4cc1-ac70-26c1cd86330f tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:51:51.939044 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8b25fc35-f004-4cc1-ac70-26c1cd86330f tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:51:51.939793 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8b25fc35-f004-4cc1-ac70-26c1cd86330f tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:51:51.940852 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8b25fc35-f004-4cc1-ac70-26c1cd86330f tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:51:51.944504 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8b25fc35-f004-4cc1-ac70-26c1cd86330f tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:51:52.331524 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-8b25fc35-f004-4cc1-ac70-26c1cd86330f tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:51:52.350529 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-8b25fc35-f004-4cc1-ac70-26c1cd86330f tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1272 microversion: 2.1 time: 0.428734 Nov 21 13:51:52.357113 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 17/44] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:51:51 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1272 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:51:52.512715 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-60ae8e07-e383-4d4a-adac-0af4a88c0265 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Getting quotas for project 389c281a19bb49e583633f57108f7f69. Resources: {'key_pairs'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:51:52.522768 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-60ae8e07-e383-4d4a-adac-0af4a88c0265 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Getting quotas for user 07abcb2febc44ec8a0a2493b53233a66 and project 389c281a19bb49e583633f57108f7f69. Resources: {'key_pairs'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:51:52.557593 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-60ae8e07-e383-4d4a-adac-0af4a88c0265 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 2.692109 Nov 21 13:51:52.559463 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 28/45] 10.222.0.11 () {60 vars in 1157 bytes} [Sun Nov 21 13:51:49 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 2694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:51:53.376042 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ace0895d-3b3f-45db-92ba-602f9a379214 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:53.377672 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ace0895d-3b3f-45db-92ba-602f9a379214 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:51:53.398190 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ace0895d-3b3f-45db-92ba-602f9a379214 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:51:53.401586 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ace0895d-3b3f-45db-92ba-602f9a379214 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:51:53.404834 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ace0895d-3b3f-45db-92ba-602f9a379214 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:51:53.405568 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ace0895d-3b3f-45db-92ba-602f9a379214 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:51:54.519979 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-ace0895d-3b3f-45db-92ba-602f9a379214 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:51:54.546916 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ace0895d-3b3f-45db-92ba-602f9a379214 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1314 microversion: 2.1 time: 1.166863 Nov 21 13:51:54.559782 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 18/46] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:51:53 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1314 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:51:55.564980 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c3505f42-8b77-4878-ae53-1da4c0fba3c2 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:55.567153 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-c3505f42-8b77-4878-ae53-1da4c0fba3c2 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:51:55.594654 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c3505f42-8b77-4878-ae53-1da4c0fba3c2 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:51:55.596388 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c3505f42-8b77-4878-ae53-1da4c0fba3c2 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:51:55.603988 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c3505f42-8b77-4878-ae53-1da4c0fba3c2 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:51:55.604773 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c3505f42-8b77-4878-ae53-1da4c0fba3c2 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:51:56.790963 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-c3505f42-8b77-4878-ae53-1da4c0fba3c2 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:51:56.831564 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c3505f42-8b77-4878-ae53-1da4c0fba3c2 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1314 microversion: 2.1 time: 1.269592 Nov 21 13:51:56.834201 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 29/47] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:51:55 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1314 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:51:56.941593 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-7ca0bffd-237b-4e29-9267-85247965e136 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'create', calling method: .version_select at 0x7fd520908af0>, body: {"keypair": {"name": "tempest-keypair-2038718668"}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:51:56.992005 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-7ca0bffd-237b-4e29-9267-85247965e136 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Getting quotas for project 3d25ecbdc2ba435488271022d897a406. Resources: {'key_pairs'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:51:57.018891 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-7ca0bffd-237b-4e29-9267-85247965e136 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Getting quotas for user 67da79fc92074be09b188b5ba9edd098 and project 3d25ecbdc2ba435488271022d897a406. Resources: {'key_pairs'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:51:57.537532 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-7ca0bffd-237b-4e29-9267-85247965e136 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Getting quotas for project 3d25ecbdc2ba435488271022d897a406. Resources: {'key_pairs'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:51:57.560567 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-7ca0bffd-237b-4e29-9267-85247965e136 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Getting quotas for user 67da79fc92074be09b188b5ba9edd098 and project 3d25ecbdc2ba435488271022d897a406. Resources: {'key_pairs'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:51:57.603009 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-7ca0bffd-237b-4e29-9267-85247965e136 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.478620 Nov 21 13:51:57.603722 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 19/48] 10.222.0.11 () {62 vars in 1198 bytes} [Sun Nov 21 13:51:56 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1481 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 21 13:51:57.851001 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-7ca4a1c9-b7ce-46cd-b1d2-8b9055916fdc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:51:57.851691 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-7ca4a1c9-b7ce-46cd-b1d2-8b9055916fdc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:51:57.875272 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7ca4a1c9-b7ce-46cd-b1d2-8b9055916fdc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:51:57.875747 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7ca4a1c9-b7ce-46cd-b1d2-8b9055916fdc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:51:57.877396 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7ca4a1c9-b7ce-46cd-b1d2-8b9055916fdc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:51:57.878152 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7ca4a1c9-b7ce-46cd-b1d2-8b9055916fdc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:00.399101 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-7ca4a1c9-b7ce-46cd-b1d2-8b9055916fdc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:00.409546 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-7ca4a1c9-b7ce-46cd-b1d2-8b9055916fdc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1314 microversion: 2.1 time: 2.562921 Nov 21 13:52:00.413950 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 30/49] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:51:57 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1314 bytes in 2568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:00.526664 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-6d5b4801-832c-4da1-a198-020c040d663c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1357508335", "imageRef": "acdb574e-2ba9-4029-849b-377b4d5722ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a"}]}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:00.672252 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.network.neutron [None req-6d5b4801-832c-4da1-a198-020c040d663c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] validate_networks() for [('63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a', None, None, None, None, None)] {{(pid=122564) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 21 13:52:01.440753 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-469da605-cd27-4c5d-a61e-0c0be15848f2 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:01.443589 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-469da605-cd27-4c5d-a61e-0c0be15848f2 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:01.465141 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-469da605-cd27-4c5d-a61e-0c0be15848f2 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:01.468120 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-469da605-cd27-4c5d-a61e-0c0be15848f2 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:01.471134 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-469da605-cd27-4c5d-a61e-0c0be15848f2 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:01.480013 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-469da605-cd27-4c5d-a61e-0c0be15848f2 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:02.948947 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-469da605-cd27-4c5d-a61e-0c0be15848f2 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:02.968909 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-6d5b4801-832c-4da1-a198-020c040d663c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Flavor limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 13:52:02.970822 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-6d5b4801-832c-4da1-a198-020c040d663c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Image limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 13:52:02.971230 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-469da605-cd27-4c5d-a61e-0c0be15848f2 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1314 microversion: 2.1 time: 1.541013 Nov 21 13:52:02.971937 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-6d5b4801-832c-4da1-a198-020c040d663c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Flavor pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 13:52:02.972602 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-6d5b4801-832c-4da1-a198-020c040d663c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Image pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 13:52:02.974196 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-6d5b4801-832c-4da1-a198-020c040d663c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 13:52:02.974542 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 31/50] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:01 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1314 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:03.003297 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6d5b4801-832c-4da1-a198-020c040d663c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:03.006434 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6d5b4801-832c-4da1-a198-020c040d663c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:03.008225 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6d5b4801-832c-4da1-a198-020c040d663c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:03.009732 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6d5b4801-832c-4da1-a198-020c040d663c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:03.062733 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-6d5b4801-832c-4da1-a198-020c040d663c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Getting quotas for project c90104f2696540809e93549d7ed3695f. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:52:03.088280 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-6d5b4801-832c-4da1-a198-020c040d663c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Getting quotas for user fd748cde4c5e443bb6d87d862cf31357 and project c90104f2696540809e93549d7ed3695f. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:52:03.128948 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-6d5b4801-832c-4da1-a198-020c040d663c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Going to run 1 instances... {{(pid=122564) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 13:52:03.138643 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-6d5b4801-832c-4da1-a198-020c040d663c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='acdb574e-2ba9-4029-849b-377b4d5722ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 13:52:03.352551 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-6d5b4801-832c-4da1-a198-020c040d663c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.518067 Nov 21 13:52:03.362202 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 20/51] 10.222.0.11 () {60 vars in 1146 bytes} [Sun Nov 21 13:51:59 2021] POST /compute/v2.1/servers => generated 383 bytes in 3530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 13:52:03.366100 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-8c0c7b7f-abc3-432f-b059-532b9077d3cd tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:03.366862 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-8c0c7b7f-abc3-432f-b059-532b9077d3cd tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:03.493949 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-690977398", "imageRef": "acdb574e-2ba9-4029-849b-377b4d5722ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea19090b-8034-4904-8b6c-1752befe0b5a"}], "security_groups": [{"name": "tempest-securitygroup--908046903"}], "key_name": "tempest-keypair-1306439029", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:03.877467 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-8c0c7b7f-abc3-432f-b059-532b9077d3cd tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:03.922509 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-8c0c7b7f-abc3-432f-b059-532b9077d3cd tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1222 microversion: 2.1 time: 0.552945 Nov 21 13:52:03.929879 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 32/52] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:03 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1222 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:04.119488 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.network.neutron [None req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] validate_networks() for [('ea19090b-8034-4904-8b6c-1752befe0b5a', None, None, None, None, None)] {{(pid=122564) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 21 13:52:04.222288 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-c93f8665-c570-4ca7-98cb-ff6157e455cf req-253b9699-7eaf-445c-a554-33e3fd3f3b1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7ac629e-e375-4954-82d0-1efb9da7da3b", "tag": "8653e663-5da8-4b7e-91b0-8c94d45d51ad"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:04.224695 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:52:04.224695 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:52:04.252504 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-c93f8665-c570-4ca7-98cb-ff6157e455cf req-253b9699-7eaf-445c-a554-33e3fd3f3b1f service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:04.256047 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-c93f8665-c570-4ca7-98cb-ff6157e455cf req-253b9699-7eaf-445c-a554-33e3fd3f3b1f service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:04.328156 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-c93f8665-c570-4ca7-98cb-ff6157e455cf req-253b9699-7eaf-445c-a554-33e3fd3f3b1f service nova] Creating event network-changed:8653e663-5da8-4b7e-91b0-8c94d45d51ad for instance f7ac629e-e375-4954-82d0-1efb9da7da3b on hv-cinder-76845 Nov 21 13:52:04.331103 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-c93f8665-c570-4ca7-98cb-ff6157e455cf req-253b9699-7eaf-445c-a554-33e3fd3f3b1f service nova] Acquired lock "compute-rpcapi-router" {{(pid=122565) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 21 13:52:04.334830 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b8ef5370-9a94-4bae-9b64-c5548013f10e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:04.335723 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b8ef5370-9a94-4bae-9b64-c5548013f10e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:04.338162 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b8ef5370-9a94-4bae-9b64-c5548013f10e None None] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:04.339531 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b8ef5370-9a94-4bae-9b64-c5548013f10e None None] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:04.368455 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.compute.rpcapi [None req-b8ef5370-9a94-4bae-9b64-c5548013f10e None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 21 13:52:04.381666 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b8ef5370-9a94-4bae-9b64-c5548013f10e None None] Releasing lock "compute-rpcapi-router" {{(pid=122565) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 21 13:52:04.449140 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-b8ef5370-9a94-4bae-9b64-c5548013f10e None None] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.516679 Nov 21 13:52:04.450719 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 33/53] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:52:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:52:04.461580 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-38af1e8e-c497-4a33-b9ee-41848bba3d14 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:04.463430 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-38af1e8e-c497-4a33-b9ee-41848bba3d14 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:04.491721 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-38af1e8e-c497-4a33-b9ee-41848bba3d14 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:04.492717 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-38af1e8e-c497-4a33-b9ee-41848bba3d14 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:04.494105 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-38af1e8e-c497-4a33-b9ee-41848bba3d14 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:04.494823 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-38af1e8e-c497-4a33-b9ee-41848bba3d14 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:05.914618 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-38af1e8e-c497-4a33-b9ee-41848bba3d14 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:05.923590 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-38af1e8e-c497-4a33-b9ee-41848bba3d14 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1314 microversion: 2.1 time: 1.471066 Nov 21 13:52:05.938225 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 34/54] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:04 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1314 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:05.953193 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-553838958", "imageRef": "acdb574e-2ba9-4029-849b-377b4d5722ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a"}]}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:05.980799 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Flavor limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 13:52:05.981689 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Image limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 13:52:05.982224 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Flavor pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 13:52:05.982739 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Image pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 13:52:05.983161 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 13:52:06.001444 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:06.007707 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:06.009137 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:06.009821 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:06.093199 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Getting quotas for project 389c281a19bb49e583633f57108f7f69. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:52:06.104401 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.network.neutron [None req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] validate_networks() for [('63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a', None, None, None, None, None)] {{(pid=122565) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 21 13:52:06.112255 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Getting quotas for user 07abcb2febc44ec8a0a2493b53233a66 and project 389c281a19bb49e583633f57108f7f69. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:52:06.147493 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Going to run 1 instances... {{(pid=122564) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 13:52:06.149736 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='acdb574e-2ba9-4029-849b-377b4d5722ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 13:52:06.253339 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.768006 Nov 21 13:52:06.255345 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 21/55] 10.222.0.11 () {60 vars in 1146 bytes} [Sun Nov 21 13:52:03 2021] POST /compute/v2.1/servers => generated 401 bytes in 2772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 21 13:52:06.281395 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-05613888-9dfe-4844-8c92-11e7102de97a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:06.282475 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-05613888-9dfe-4844-8c92-11e7102de97a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:06.467332 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-05613888-9dfe-4844-8c92-11e7102de97a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:06.479728 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-05613888-9dfe-4844-8c92-11e7102de97a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1237 microversion: 2.1 time: 0.209407 Nov 21 13:52:06.483067 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 22/56] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:06 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1237 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:06.742363 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-da676032-414c-4464-a4fd-70ce5e69bd87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-302062963", "imageRef": "acdb574e-2ba9-4029-849b-377b4d5722ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24c864ef-5c5a-4df8-8968-78a7fe30b188"}], "security_groups": [{"name": "tempest-securitygroup--1544131445"}], "key_name": "tempest-keypair-2038718668", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:07.172681 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.network.neutron [None req-da676032-414c-4464-a4fd-70ce5e69bd87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] validate_networks() for [('24c864ef-5c5a-4df8-8968-78a7fe30b188', None, None, None, None, None)] {{(pid=122564) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 21 13:52:08.066100 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-da676032-414c-4464-a4fd-70ce5e69bd87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Flavor limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 13:52:08.066627 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-da676032-414c-4464-a4fd-70ce5e69bd87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Image limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 13:52:08.067253 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-da676032-414c-4464-a4fd-70ce5e69bd87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Flavor pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 13:52:08.068152 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-da676032-414c-4464-a4fd-70ce5e69bd87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Image pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 13:52:08.068742 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-da676032-414c-4464-a4fd-70ce5e69bd87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 13:52:08.083652 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-da676032-414c-4464-a4fd-70ce5e69bd87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:08.084138 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-da676032-414c-4464-a4fd-70ce5e69bd87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:08.084954 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-da676032-414c-4464-a4fd-70ce5e69bd87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:08.085392 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-da676032-414c-4464-a4fd-70ce5e69bd87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:08.114950 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-da676032-414c-4464-a4fd-70ce5e69bd87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Getting quotas for project 3d25ecbdc2ba435488271022d897a406. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:52:08.122302 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-da676032-414c-4464-a4fd-70ce5e69bd87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Getting quotas for user 67da79fc92074be09b188b5ba9edd098 and project 3d25ecbdc2ba435488271022d897a406. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:52:08.163032 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-da676032-414c-4464-a4fd-70ce5e69bd87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Going to run 1 instances... {{(pid=122564) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 13:52:08.165462 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-da676032-414c-4464-a4fd-70ce5e69bd87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='acdb574e-2ba9-4029-849b-377b4d5722ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 13:52:08.369934 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-da676032-414c-4464-a4fd-70ce5e69bd87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.633708 Nov 21 13:52:08.376426 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 23/57] 10.222.0.11 () {62 vars in 1187 bytes} [Sun Nov 21 13:52:06 2021] POST /compute/v2.1/servers => generated 402 bytes in 1641 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 21 13:52:08.385357 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-1ec0fc4e-a6da-462a-922e-bbe30be57dbb tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:08.403009 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-1ec0fc4e-a6da-462a-922e-bbe30be57dbb tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:08.436124 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1ec0fc4e-a6da-462a-922e-bbe30be57dbb tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:08.438433 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1ec0fc4e-a6da-462a-922e-bbe30be57dbb tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:08.442858 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1ec0fc4e-a6da-462a-922e-bbe30be57dbb tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:08.444354 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1ec0fc4e-a6da-462a-922e-bbe30be57dbb tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:08.969404 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-1ec0fc4e-a6da-462a-922e-bbe30be57dbb tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:08.978726 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-1ec0fc4e-a6da-462a-922e-bbe30be57dbb tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1314 microversion: 2.1 time: 0.598407 Nov 21 13:52:08.980938 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 24/58] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:08 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:08.994500 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-525c3ab3-07a1-474e-a085-0c0cc92f4803 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:08.995665 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-525c3ab3-07a1-474e-a085-0c0cc92f4803 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:09.008765 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-525c3ab3-07a1-474e-a085-0c0cc92f4803 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:09.009540 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-525c3ab3-07a1-474e-a085-0c0cc92f4803 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:09.010515 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-525c3ab3-07a1-474e-a085-0c0cc92f4803 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:09.011125 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-525c3ab3-07a1-474e-a085-0c0cc92f4803 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:09.183243 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-525c3ab3-07a1-474e-a085-0c0cc92f4803 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:09.191093 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-525c3ab3-07a1-474e-a085-0c0cc92f4803 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1295 microversion: 2.1 time: 0.208783 Nov 21 13:52:09.194814 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 25/59] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:08 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1295 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:09.205855 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-582f2a7a-9db9-4bb7-a224-ef60f9ffb55b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:09.206651 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-582f2a7a-9db9-4bb7-a224-ef60f9ffb55b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:09.224318 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Flavor limits 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 13:52:09.224840 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Image limits 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 13:52:09.225357 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Flavor pref 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 13:52:09.225841 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Image pref 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 13:52:09.226352 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 13:52:09.262731 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:09.272916 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:09.279872 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:09.282383 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:09.375162 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Getting quotas for project c90104f2696540809e93549d7ed3695f. Resources: {'instances', 'ram', 'cores'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:52:09.386532 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Getting quotas for user fd748cde4c5e443bb6d87d862cf31357 and project c90104f2696540809e93549d7ed3695f. Resources: {'instances', 'ram', 'cores'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:52:09.413367 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Going to run 1 instances... {{(pid=122565) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 13:52:09.419525 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='acdb574e-2ba9-4029-849b-377b4d5722ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 13:52:09.523217 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-582f2a7a-9db9-4bb7-a224-ef60f9ffb55b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:09.546766 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-582f2a7a-9db9-4bb7-a224-ef60f9ffb55b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:09.555915 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-582f2a7a-9db9-4bb7-a224-ef60f9ffb55b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:09.557287 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-582f2a7a-9db9-4bb7-a224-ef60f9ffb55b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1281 microversion: 2.20 time: 0.360412 Nov 21 13:52:09.568244 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 26/60] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:09 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1281 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:09.600593 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.659810 Nov 21 13:52:09.608331 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 35/61] 10.222.0.11 () {60 vars in 1146 bytes} [Sun Nov 21 13:52:05 2021] POST /compute/v2.1/servers => generated 383 bytes in 3669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 13:52:09.614727 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-4f12972c-c5b5-4712-85da-4fbe0e3c1d07 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:09.615843 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-4f12972c-c5b5-4712-85da-4fbe0e3c1d07 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:09.771977 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-4f12972c-c5b5-4712-85da-4fbe0e3c1d07 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:09.784242 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-4f12972c-c5b5-4712-85da-4fbe0e3c1d07 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1221 microversion: 2.1 time: 0.170016 Nov 21 13:52:09.785936 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 27/62] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:09 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1221 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:09.998700 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-8fc034b4-28e7-4cdb-b5d6-5b564ac5684b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:09.999707 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-8fc034b4-28e7-4cdb-b5d6-5b564ac5684b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:10.032607 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8fc034b4-28e7-4cdb-b5d6-5b564ac5684b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:10.033770 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8fc034b4-28e7-4cdb-b5d6-5b564ac5684b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:10.034772 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8fc034b4-28e7-4cdb-b5d6-5b564ac5684b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:10.040106 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8fc034b4-28e7-4cdb-b5d6-5b564ac5684b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:10.211053 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-aa27745c-0a54-4925-9cd8-303bbe195424 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:10.211943 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-aa27745c-0a54-4925-9cd8-303bbe195424 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:10.225330 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-aa27745c-0a54-4925-9cd8-303bbe195424 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:10.228293 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-aa27745c-0a54-4925-9cd8-303bbe195424 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:10.233994 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-aa27745c-0a54-4925-9cd8-303bbe195424 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:10.235493 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-aa27745c-0a54-4925-9cd8-303bbe195424 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:10.791951 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-aa27745c-0a54-4925-9cd8-303bbe195424 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:10.806574 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-aa27745c-0a54-4925-9cd8-303bbe195424 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1362 microversion: 2.1 time: 0.599688 Nov 21 13:52:10.811791 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 28/63] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:10 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1362 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:10.820462 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-aa3fcbab-3b40-4d12-93a2-de252bc43714 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:10.826146 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-aa3fcbab-3b40-4d12-93a2-de252bc43714 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:10.836976 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-aa3fcbab-3b40-4d12-93a2-de252bc43714 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:10.837586 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-aa3fcbab-3b40-4d12-93a2-de252bc43714 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:10.838656 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-aa3fcbab-3b40-4d12-93a2-de252bc43714 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:10.839475 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-aa3fcbab-3b40-4d12-93a2-de252bc43714 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:10.959788 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-aa3fcbab-3b40-4d12-93a2-de252bc43714 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:10.969363 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-aa3fcbab-3b40-4d12-93a2-de252bc43714 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:10.970941 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-aa3fcbab-3b40-4d12-93a2-de252bc43714 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:10.972173 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-aa3fcbab-3b40-4d12-93a2-de252bc43714 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1339 microversion: 2.20 time: 0.159216 Nov 21 13:52:10.973564 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 29/64] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:10 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1339 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:10.978101 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-4b0c50ee-8f2f-4e82-a509-925baf7d1882 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:10.978860 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-4b0c50ee-8f2f-4e82-a509-925baf7d1882 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:10.985403 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4b0c50ee-8f2f-4e82-a509-925baf7d1882 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:10.986067 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4b0c50ee-8f2f-4e82-a509-925baf7d1882 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:10.987280 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4b0c50ee-8f2f-4e82-a509-925baf7d1882 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:10.989451 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4b0c50ee-8f2f-4e82-a509-925baf7d1882 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:11.069498 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-8fc034b4-28e7-4cdb-b5d6-5b564ac5684b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:11.077484 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-8fc034b4-28e7-4cdb-b5d6-5b564ac5684b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1314 microversion: 2.1 time: 1.083447 Nov 21 13:52:11.088580 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 36/65] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:09 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1314 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:11.261701 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-4b0c50ee-8f2f-4e82-a509-925baf7d1882 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:11.276990 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-4b0c50ee-8f2f-4e82-a509-925baf7d1882 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1273 microversion: 2.1 time: 0.302086 Nov 21 13:52:11.289292 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 30/66] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:10 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1273 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:11.833026 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-7a61046a-df36-4f9f-8e6b-58f2b83dfeaf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:11.841172 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-7a61046a-df36-4f9f-8e6b-58f2b83dfeaf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:11.880190 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7a61046a-df36-4f9f-8e6b-58f2b83dfeaf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:11.880855 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7a61046a-df36-4f9f-8e6b-58f2b83dfeaf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:11.881876 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7a61046a-df36-4f9f-8e6b-58f2b83dfeaf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:11.882471 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7a61046a-df36-4f9f-8e6b-58f2b83dfeaf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:11.991379 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-172fb124-44c4-41f2-a742-cf315cc64c41 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:11.992574 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-172fb124-44c4-41f2-a742-cf315cc64c41 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:12.006435 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-172fb124-44c4-41f2-a742-cf315cc64c41 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:12.008438 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-172fb124-44c4-41f2-a742-cf315cc64c41 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:12.011086 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-172fb124-44c4-41f2-a742-cf315cc64c41 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:12.012164 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-172fb124-44c4-41f2-a742-cf315cc64c41 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:12.167462 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-172fb124-44c4-41f2-a742-cf315cc64c41 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:12.181291 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-172fb124-44c4-41f2-a742-cf315cc64c41 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:12.191877 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-172fb124-44c4-41f2-a742-cf315cc64c41 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:12.196249 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-172fb124-44c4-41f2-a742-cf315cc64c41 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1339 microversion: 2.20 time: 0.206866 Nov 21 13:52:12.198829 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 31/67] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:11 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1339 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:12.211457 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2953ea71-f6b2-4cf4-889f-65011ceac037 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:12.213163 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-2953ea71-f6b2-4cf4-889f-65011ceac037 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:12.230831 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2953ea71-f6b2-4cf4-889f-65011ceac037 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:12.232541 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2953ea71-f6b2-4cf4-889f-65011ceac037 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:12.234308 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2953ea71-f6b2-4cf4-889f-65011ceac037 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:12.235916 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2953ea71-f6b2-4cf4-889f-65011ceac037 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:12.845971 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-7a61046a-df36-4f9f-8e6b-58f2b83dfeaf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:12.860023 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-2953ea71-f6b2-4cf4-889f-65011ceac037 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:12.861910 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-7a61046a-df36-4f9f-8e6b-58f2b83dfeaf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1362 microversion: 2.1 time: 1.036079 Nov 21 13:52:12.863379 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 37/68] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:11 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1362 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:12.870219 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-2953ea71-f6b2-4cf4-889f-65011ceac037 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1314 microversion: 2.1 time: 0.667814 Nov 21 13:52:12.875960 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-b6a10f93-74f2-4aa6-8de7-07e163139461 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:12.879934 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 32/69] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:12 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1314 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:12.881126 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-b6a10f93-74f2-4aa6-8de7-07e163139461 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:12.901472 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b6a10f93-74f2-4aa6-8de7-07e163139461 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:12.906080 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b6a10f93-74f2-4aa6-8de7-07e163139461 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:12.907201 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b6a10f93-74f2-4aa6-8de7-07e163139461 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:12.909635 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b6a10f93-74f2-4aa6-8de7-07e163139461 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:13.084561 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-b6a10f93-74f2-4aa6-8de7-07e163139461 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:13.099688 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-b6a10f93-74f2-4aa6-8de7-07e163139461 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1279 microversion: 2.1 time: 0.234372 Nov 21 13:52:13.101095 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 38/70] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:12 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1279 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:13.268182 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-9aedcaf8-5197-4542-b6fa-16b870d687da req-4f299e52-4be5-49fa-a082-4b411db411cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ac629e-e375-4954-82d0-1efb9da7da3b", "name": "network-vif-plugged", "status": "completed", "tag": "8653e663-5da8-4b7e-91b0-8c94d45d51ad"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:13.272132 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:52:13.272132 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:52:13.299366 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-9aedcaf8-5197-4542-b6fa-16b870d687da req-4f299e52-4be5-49fa-a082-4b411db411cd service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:13.312090 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-9aedcaf8-5197-4542-b6fa-16b870d687da req-4f299e52-4be5-49fa-a082-4b411db411cd service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:13.333414 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-a448820a-51e8-4154-af11-fe69eadc54d7 req-6958899e-c3ef-48d3-aa54-0d39c4b72a43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa7ec26-0d3e-4d40-87d2-45e63ed435eb", "tag": "e97fd0d3-216a-4615-aa4a-a98857cba123"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:13.336171 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:52:13.336171 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:52:13.350190 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-a448820a-51e8-4154-af11-fe69eadc54d7 req-6958899e-c3ef-48d3-aa54-0d39c4b72a43 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:13.354921 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-a448820a-51e8-4154-af11-fe69eadc54d7 req-6958899e-c3ef-48d3-aa54-0d39c4b72a43 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:13.381306 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-9aedcaf8-5197-4542-b6fa-16b870d687da req-4f299e52-4be5-49fa-a082-4b411db411cd service nova] Creating event network-vif-plugged:8653e663-5da8-4b7e-91b0-8c94d45d51ad for instance f7ac629e-e375-4954-82d0-1efb9da7da3b on hv-cinder-76845 Nov 21 13:52:13.384383 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-9aedcaf8-5197-4542-b6fa-16b870d687da req-4f299e52-4be5-49fa-a082-4b411db411cd service nova] Acquired lock "compute-rpcapi-router" {{(pid=122564) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 21 13:52:13.390798 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-01e73302-277c-4d79-9aa9-eadb58973b2c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:13.392192 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-a448820a-51e8-4154-af11-fe69eadc54d7 req-6958899e-c3ef-48d3-aa54-0d39c4b72a43 service nova] Creating event network-changed:e97fd0d3-216a-4615-aa4a-a98857cba123 for instance 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb on hv-cinder-76845 Nov 21 13:52:13.393802 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-01e73302-277c-4d79-9aa9-eadb58973b2c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:13.396580 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-01e73302-277c-4d79-9aa9-eadb58973b2c None None] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:13.397107 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-01e73302-277c-4d79-9aa9-eadb58973b2c None None] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:13.407589 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-a448820a-51e8-4154-af11-fe69eadc54d7 req-6958899e-c3ef-48d3-aa54-0d39c4b72a43 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.302894 Nov 21 13:52:13.410816 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 39/71] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:52:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:52:13.426342 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-6b39c40d-e6d6-46de-8c10-1ca6f06034d1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:13.429394 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.compute.rpcapi [None req-01e73302-277c-4d79-9aa9-eadb58973b2c None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 21 13:52:13.430985 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-6b39c40d-e6d6-46de-8c10-1ca6f06034d1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:13.432112 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-01e73302-277c-4d79-9aa9-eadb58973b2c None None] Releasing lock "compute-rpcapi-router" {{(pid=122564) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 21 13:52:13.456208 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6b39c40d-e6d6-46de-8c10-1ca6f06034d1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:13.456845 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6b39c40d-e6d6-46de-8c10-1ca6f06034d1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:13.462614 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6b39c40d-e6d6-46de-8c10-1ca6f06034d1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:13.463647 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6b39c40d-e6d6-46de-8c10-1ca6f06034d1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:13.508724 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-01e73302-277c-4d79-9aa9-eadb58973b2c None None] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.627518 Nov 21 13:52:13.509606 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 33/72] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:52:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:52:13.516887 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-ec9a05eb-58fd-4d8e-b4d0-46934823a244 req-27700a19-1fff-41c5-bf9c-5b512e46f795 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d1c9d3d-f088-4d2f-b2bc-e26543509aae", "tag": "e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:13.532657 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:52:13.532657 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:52:13.549563 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-ec9a05eb-58fd-4d8e-b4d0-46934823a244 req-27700a19-1fff-41c5-bf9c-5b512e46f795 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:13.551732 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-ec9a05eb-58fd-4d8e-b4d0-46934823a244 req-27700a19-1fff-41c5-bf9c-5b512e46f795 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:13.569225 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-ec9a05eb-58fd-4d8e-b4d0-46934823a244 req-27700a19-1fff-41c5-bf9c-5b512e46f795 service nova] Creating event network-changed:e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 for instance 2d1c9d3d-f088-4d2f-b2bc-e26543509aae on hv-cinder-76845 Nov 21 13:52:13.577325 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-ec9a05eb-58fd-4d8e-b4d0-46934823a244 req-27700a19-1fff-41c5-bf9c-5b512e46f795 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065289 Nov 21 13:52:13.579039 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 34/73] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:52:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:52:13.879396 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-36fb3f43-8585-46f2-abf9-460833d8dca4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:13.880422 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-36fb3f43-8585-46f2-abf9-460833d8dca4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:13.889486 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-36fb3f43-8585-46f2-abf9-460833d8dca4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:13.890296 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-36fb3f43-8585-46f2-abf9-460833d8dca4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:13.891284 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-36fb3f43-8585-46f2-abf9-460833d8dca4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:13.892011 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-36fb3f43-8585-46f2-abf9-460833d8dca4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:13.974109 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-6b39c40d-e6d6-46de-8c10-1ca6f06034d1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:13.984078 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-6b39c40d-e6d6-46de-8c10-1ca6f06034d1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:13.986104 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-6b39c40d-e6d6-46de-8c10-1ca6f06034d1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:13.992728 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-6b39c40d-e6d6-46de-8c10-1ca6f06034d1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.574021 Nov 21 13:52:13.993612 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 40/74] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:13 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:14.001091 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a62fa1b1-fde0-4dd3-9f00-1a1e7cf3db0e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:14.002058 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a62fa1b1-fde0-4dd3-9f00-1a1e7cf3db0e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:14.010457 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a62fa1b1-fde0-4dd3-9f00-1a1e7cf3db0e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:14.011242 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a62fa1b1-fde0-4dd3-9f00-1a1e7cf3db0e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:14.013257 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a62fa1b1-fde0-4dd3-9f00-1a1e7cf3db0e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:14.014676 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a62fa1b1-fde0-4dd3-9f00-1a1e7cf3db0e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:14.392063 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-36fb3f43-8585-46f2-abf9-460833d8dca4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:14.404703 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-36fb3f43-8585-46f2-abf9-460833d8dca4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1362 microversion: 2.1 time: 0.529869 Nov 21 13:52:14.405534 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 35/75] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:13 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1362 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:14.410722 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-8d69921b-f462-4258-a167-30a8e72e368f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:14.411442 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-8d69921b-f462-4258-a167-30a8e72e368f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:14.417166 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8d69921b-f462-4258-a167-30a8e72e368f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:14.418089 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8d69921b-f462-4258-a167-30a8e72e368f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:14.419429 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8d69921b-f462-4258-a167-30a8e72e368f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:14.420101 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8d69921b-f462-4258-a167-30a8e72e368f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:14.628269 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a62fa1b1-fde0-4dd3-9f00-1a1e7cf3db0e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:14.639301 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-8d69921b-f462-4258-a167-30a8e72e368f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:14.639543 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a62fa1b1-fde0-4dd3-9f00-1a1e7cf3db0e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1314 microversion: 2.1 time: 0.644020 Nov 21 13:52:14.641216 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 41/76] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:13 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:14.650613 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-8d69921b-f462-4258-a167-30a8e72e368f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.242897 Nov 21 13:52:14.653237 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 36/77] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:14 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:15.010530 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-9c62d1b7-51ff-4905-b2a2-116621337474 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:15.013283 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-9c62d1b7-51ff-4905-b2a2-116621337474 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:15.020100 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9c62d1b7-51ff-4905-b2a2-116621337474 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:15.020908 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9c62d1b7-51ff-4905-b2a2-116621337474 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:15.022255 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9c62d1b7-51ff-4905-b2a2-116621337474 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:15.022987 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9c62d1b7-51ff-4905-b2a2-116621337474 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:15.184452 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-9c62d1b7-51ff-4905-b2a2-116621337474 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:15.193146 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-9c62d1b7-51ff-4905-b2a2-116621337474 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:15.194643 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-9c62d1b7-51ff-4905-b2a2-116621337474 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:15.195747 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-9c62d1b7-51ff-4905-b2a2-116621337474 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.188895 Nov 21 13:52:15.196332 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 42/78] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:15 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:15.422090 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-5b55fcff-f0b2-4478-8242-ce3d43ff3326 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:15.422693 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-5b55fcff-f0b2-4478-8242-ce3d43ff3326 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:15.429227 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5b55fcff-f0b2-4478-8242-ce3d43ff3326 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:15.429672 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5b55fcff-f0b2-4478-8242-ce3d43ff3326 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:15.430436 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5b55fcff-f0b2-4478-8242-ce3d43ff3326 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:15.430871 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5b55fcff-f0b2-4478-8242-ce3d43ff3326 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:15.559647 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-5b55fcff-f0b2-4478-8242-ce3d43ff3326 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:15.566738 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-5b55fcff-f0b2-4478-8242-ce3d43ff3326 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1362 microversion: 2.1 time: 0.148340 Nov 21 13:52:15.567295 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 37/79] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:15 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:15.633123 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-4f191cfb-ae21-44a0-80de-f07adca4235b req-fa3937f0-71e2-42ed-aa83-e9b1174fb52c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e92c59-3be1-41c7-8ea1-b1bb65cf39c1", "tag": "627d561d-d2ff-449e-a99f-9e5e3fd874ba"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:15.634688 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:52:15.634688 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:52:15.641452 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-4f191cfb-ae21-44a0-80de-f07adca4235b req-fa3937f0-71e2-42ed-aa83-e9b1174fb52c service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:15.641904 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-4f191cfb-ae21-44a0-80de-f07adca4235b req-fa3937f0-71e2-42ed-aa83-e9b1174fb52c service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:15.652712 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-4f191cfb-ae21-44a0-80de-f07adca4235b req-fa3937f0-71e2-42ed-aa83-e9b1174fb52c service nova] Creating event network-changed:627d561d-d2ff-449e-a99f-9e5e3fd874ba for instance 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 on hv-cinder-76845 Nov 21 13:52:15.657497 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-4f191cfb-ae21-44a0-80de-f07adca4235b req-fa3937f0-71e2-42ed-aa83-e9b1174fb52c service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027994 Nov 21 13:52:15.657788 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-d1a6981e-170f-479a-a6da-0138fc60e06a tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:15.658079 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 43/80] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:52:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:52:15.658599 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-d1a6981e-170f-479a-a6da-0138fc60e06a tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:15.665873 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d1a6981e-170f-479a-a6da-0138fc60e06a tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:15.666423 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d1a6981e-170f-479a-a6da-0138fc60e06a tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:15.667293 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d1a6981e-170f-479a-a6da-0138fc60e06a tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:15.667763 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d1a6981e-170f-479a-a6da-0138fc60e06a tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:15.668576 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ada5b0d5-b0f4-49c3-b977-5a9c4efeb8f8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:15.669280 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ada5b0d5-b0f4-49c3-b977-5a9c4efeb8f8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:15.675213 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ada5b0d5-b0f4-49c3-b977-5a9c4efeb8f8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:15.675668 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ada5b0d5-b0f4-49c3-b977-5a9c4efeb8f8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:15.676472 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ada5b0d5-b0f4-49c3-b977-5a9c4efeb8f8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:15.676903 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ada5b0d5-b0f4-49c3-b977-5a9c4efeb8f8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:15.825707 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-d1a6981e-170f-479a-a6da-0138fc60e06a tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:15.825873 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ada5b0d5-b0f4-49c3-b977-5a9c4efeb8f8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:15.834555 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-d1a6981e-170f-479a-a6da-0138fc60e06a tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1314 microversion: 2.1 time: 0.180306 Nov 21 13:52:15.835244 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 38/81] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:15 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:15.835356 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ada5b0d5-b0f4-49c3-b977-5a9c4efeb8f8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.170920 Nov 21 13:52:15.835853 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 44/82] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:15 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:16.213727 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-74e6ce39-5d7b-4e52-a0aa-f58c762ab552 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:16.214336 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-74e6ce39-5d7b-4e52-a0aa-f58c762ab552 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:16.220238 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-74e6ce39-5d7b-4e52-a0aa-f58c762ab552 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:16.220696 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-74e6ce39-5d7b-4e52-a0aa-f58c762ab552 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:16.221466 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-74e6ce39-5d7b-4e52-a0aa-f58c762ab552 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:16.221898 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-74e6ce39-5d7b-4e52-a0aa-f58c762ab552 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:16.346857 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-74e6ce39-5d7b-4e52-a0aa-f58c762ab552 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:16.354491 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-74e6ce39-5d7b-4e52-a0aa-f58c762ab552 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:16.356029 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-74e6ce39-5d7b-4e52-a0aa-f58c762ab552 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:16.357118 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-74e6ce39-5d7b-4e52-a0aa-f58c762ab552 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.147227 Nov 21 13:52:16.357679 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 39/83] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:16 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:16.583134 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-b5d5e787-8a9c-4c5c-a2e6-4b3904be561d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:16.583759 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-b5d5e787-8a9c-4c5c-a2e6-4b3904be561d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:16.589621 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b5d5e787-8a9c-4c5c-a2e6-4b3904be561d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:16.590080 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b5d5e787-8a9c-4c5c-a2e6-4b3904be561d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:16.590866 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b5d5e787-8a9c-4c5c-a2e6-4b3904be561d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:16.591311 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b5d5e787-8a9c-4c5c-a2e6-4b3904be561d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:16.722362 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-b5d5e787-8a9c-4c5c-a2e6-4b3904be561d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:16.729545 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-b5d5e787-8a9c-4c5c-a2e6-4b3904be561d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1362 microversion: 2.1 time: 0.150035 Nov 21 13:52:16.730105 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 45/84] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:16 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:16.852154 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-cffebce3-ad9b-41df-8798-ba4d55e24b15 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:16.852642 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-6543a679-49db-4d15-810f-21d8d41aed30 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:16.852834 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-cffebce3-ad9b-41df-8798-ba4d55e24b15 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:16.853014 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-6543a679-49db-4d15-810f-21d8d41aed30 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:16.858912 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6543a679-49db-4d15-810f-21d8d41aed30 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:16.859045 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cffebce3-ad9b-41df-8798-ba4d55e24b15 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:16.859396 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cffebce3-ad9b-41df-8798-ba4d55e24b15 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:16.859491 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6543a679-49db-4d15-810f-21d8d41aed30 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:16.860208 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cffebce3-ad9b-41df-8798-ba4d55e24b15 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:16.860306 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6543a679-49db-4d15-810f-21d8d41aed30 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:16.860644 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cffebce3-ad9b-41df-8798-ba4d55e24b15 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:16.860733 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6543a679-49db-4d15-810f-21d8d41aed30 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:17.072892 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-cffebce3-ad9b-41df-8798-ba4d55e24b15 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:17.080283 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-cffebce3-ad9b-41df-8798-ba4d55e24b15 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.231703 Nov 21 13:52:17.081053 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 40/85] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:16 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:17.235787 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-6543a679-49db-4d15-810f-21d8d41aed30 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:17.242890 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-6543a679-49db-4d15-810f-21d8d41aed30 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1314 microversion: 2.1 time: 0.394204 Nov 21 13:52:17.243446 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 46/86] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:16 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:17.374321 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-23316add-fb7a-4329-b50c-ceff79a01a71 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:17.374837 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-23316add-fb7a-4329-b50c-ceff79a01a71 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:17.381909 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-23316add-fb7a-4329-b50c-ceff79a01a71 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:17.382354 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-23316add-fb7a-4329-b50c-ceff79a01a71 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:17.383131 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-23316add-fb7a-4329-b50c-ceff79a01a71 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:17.383556 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-23316add-fb7a-4329-b50c-ceff79a01a71 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:17.520393 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-23316add-fb7a-4329-b50c-ceff79a01a71 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:17.528218 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-23316add-fb7a-4329-b50c-ceff79a01a71 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:17.529770 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-23316add-fb7a-4329-b50c-ceff79a01a71 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:17.530870 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-23316add-fb7a-4329-b50c-ceff79a01a71 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.160329 Nov 21 13:52:17.531425 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 41/87] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:17 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:17.705531 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-1f94f3e6-11f2-4be3-9e0b-51f887061906 req-28259fc3-3d1e-4091-a1f8-824f7aeffccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6f04799-b287-41b6-9756-b259d5eeddeb", "tag": "dcf844c6-0002-4d63-9e63-4bf56191c807"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:17.707945 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:52:17.707945 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:52:17.714955 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-1f94f3e6-11f2-4be3-9e0b-51f887061906 req-28259fc3-3d1e-4091-a1f8-824f7aeffccf service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:17.715530 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-1f94f3e6-11f2-4be3-9e0b-51f887061906 req-28259fc3-3d1e-4091-a1f8-824f7aeffccf service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:17.727530 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-1f94f3e6-11f2-4be3-9e0b-51f887061906 req-28259fc3-3d1e-4091-a1f8-824f7aeffccf service nova] Creating event network-changed:dcf844c6-0002-4d63-9e63-4bf56191c807 for instance e6f04799-b287-41b6-9756-b259d5eeddeb on hv-cinder-76845 Nov 21 13:52:17.732313 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-1f94f3e6-11f2-4be3-9e0b-51f887061906 req-28259fc3-3d1e-4091-a1f8-824f7aeffccf service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030687 Nov 21 13:52:17.732907 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 47/88] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:52:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:52:17.746070 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-600935ec-7b77-466a-80a2-801f4c34a08e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:17.746837 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-600935ec-7b77-466a-80a2-801f4c34a08e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:17.752805 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-600935ec-7b77-466a-80a2-801f4c34a08e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:17.753309 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-600935ec-7b77-466a-80a2-801f4c34a08e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:17.754614 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-600935ec-7b77-466a-80a2-801f4c34a08e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:17.755047 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-600935ec-7b77-466a-80a2-801f4c34a08e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:17.885770 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-600935ec-7b77-466a-80a2-801f4c34a08e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:17.893115 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-600935ec-7b77-466a-80a2-801f4c34a08e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1362 microversion: 2.1 time: 0.150648 Nov 21 13:52:17.893832 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 42/89] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:17 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:18.097556 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-2e062493-815b-402c-92cc-a6c72d9564db tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:18.098285 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-2e062493-815b-402c-92cc-a6c72d9564db tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:18.104238 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2e062493-815b-402c-92cc-a6c72d9564db tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:18.104686 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2e062493-815b-402c-92cc-a6c72d9564db tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:18.105454 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2e062493-815b-402c-92cc-a6c72d9564db tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:18.105917 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2e062493-815b-402c-92cc-a6c72d9564db tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:18.236047 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2e062493-815b-402c-92cc-a6c72d9564db tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:18.243838 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-2e062493-815b-402c-92cc-a6c72d9564db tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.150707 Nov 21 13:52:18.244402 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 48/90] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:18 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:18.260061 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-66084c7a-9d45-49fe-adc3-069e0f10b244 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:18.260677 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-66084c7a-9d45-49fe-adc3-069e0f10b244 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:18.266425 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-66084c7a-9d45-49fe-adc3-069e0f10b244 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:18.266877 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-66084c7a-9d45-49fe-adc3-069e0f10b244 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:18.267657 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-66084c7a-9d45-49fe-adc3-069e0f10b244 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:18.268115 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-66084c7a-9d45-49fe-adc3-069e0f10b244 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:18.393786 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-66084c7a-9d45-49fe-adc3-069e0f10b244 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:18.401148 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-66084c7a-9d45-49fe-adc3-069e0f10b244 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1314 microversion: 2.1 time: 0.144661 Nov 21 13:52:18.401650 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 43/91] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:18 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:18.548488 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-746df8d1-da56-4eee-bf35-6d7a1bf72509 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:18.549098 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-746df8d1-da56-4eee-bf35-6d7a1bf72509 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:18.555513 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-746df8d1-da56-4eee-bf35-6d7a1bf72509 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:18.555999 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-746df8d1-da56-4eee-bf35-6d7a1bf72509 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:18.556768 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-746df8d1-da56-4eee-bf35-6d7a1bf72509 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:18.557203 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-746df8d1-da56-4eee-bf35-6d7a1bf72509 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:18.681831 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-746df8d1-da56-4eee-bf35-6d7a1bf72509 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:18.689603 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-746df8d1-da56-4eee-bf35-6d7a1bf72509 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:18.691161 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-746df8d1-da56-4eee-bf35-6d7a1bf72509 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:18.692285 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-746df8d1-da56-4eee-bf35-6d7a1bf72509 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.147505 Nov 21 13:52:18.692843 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 49/92] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:18 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:18.910890 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-3d342945-e782-425f-b9b2-ccfa14c08f9e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:18.911523 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3d342945-e782-425f-b9b2-ccfa14c08f9e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:18.917603 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3d342945-e782-425f-b9b2-ccfa14c08f9e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:18.918054 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3d342945-e782-425f-b9b2-ccfa14c08f9e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:18.918839 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3d342945-e782-425f-b9b2-ccfa14c08f9e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:18.919275 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3d342945-e782-425f-b9b2-ccfa14c08f9e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:19.050753 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-3d342945-e782-425f-b9b2-ccfa14c08f9e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:19.058284 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-3d342945-e782-425f-b9b2-ccfa14c08f9e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1362 microversion: 2.1 time: 0.151613 Nov 21 13:52:19.058844 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 44/93] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:18 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:19.260715 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-8c75cd72-0e22-413a-9ca3-e7ca6bdfdfa8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:19.261326 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-8c75cd72-0e22-413a-9ca3-e7ca6bdfdfa8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:19.267369 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8c75cd72-0e22-413a-9ca3-e7ca6bdfdfa8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:19.267703 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8c75cd72-0e22-413a-9ca3-e7ca6bdfdfa8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:19.268765 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8c75cd72-0e22-413a-9ca3-e7ca6bdfdfa8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:19.269266 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8c75cd72-0e22-413a-9ca3-e7ca6bdfdfa8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:19.405173 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-8c75cd72-0e22-413a-9ca3-e7ca6bdfdfa8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:19.413519 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-8c75cd72-0e22-413a-9ca3-e7ca6bdfdfa8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.156340 Nov 21 13:52:19.414191 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 50/94] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:19 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:19.418254 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-caf97503-1e90-4a97-9981-3de10036d7e5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:19.418861 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-caf97503-1e90-4a97-9981-3de10036d7e5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:19.425040 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-caf97503-1e90-4a97-9981-3de10036d7e5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:19.426064 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-caf97503-1e90-4a97-9981-3de10036d7e5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:19.426867 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-caf97503-1e90-4a97-9981-3de10036d7e5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:19.427292 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-caf97503-1e90-4a97-9981-3de10036d7e5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:19.564242 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-caf97503-1e90-4a97-9981-3de10036d7e5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:19.572785 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-caf97503-1e90-4a97-9981-3de10036d7e5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1314 microversion: 2.1 time: 0.158145 Nov 21 13:52:19.574214 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 45/95] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:19 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:19.709909 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-b7945844-3bbc-4a03-a462-3722a980348d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:19.710495 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-b7945844-3bbc-4a03-a462-3722a980348d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:19.716301 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b7945844-3bbc-4a03-a462-3722a980348d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:19.716742 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b7945844-3bbc-4a03-a462-3722a980348d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:19.717507 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b7945844-3bbc-4a03-a462-3722a980348d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:19.717934 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b7945844-3bbc-4a03-a462-3722a980348d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:19.844956 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-b7945844-3bbc-4a03-a462-3722a980348d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:19.855600 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-b7945844-3bbc-4a03-a462-3722a980348d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:19.857162 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-b7945844-3bbc-4a03-a462-3722a980348d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:19.858265 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-b7945844-3bbc-4a03-a462-3722a980348d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.152069 Nov 21 13:52:19.858838 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 51/96] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:19 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:20.075467 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-98c520a6-eeb9-4efe-831d-ad9107144300 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:20.077261 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-98c520a6-eeb9-4efe-831d-ad9107144300 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:20.089356 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-98c520a6-eeb9-4efe-831d-ad9107144300 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:20.089809 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-98c520a6-eeb9-4efe-831d-ad9107144300 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:20.090595 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-98c520a6-eeb9-4efe-831d-ad9107144300 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:20.091028 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-98c520a6-eeb9-4efe-831d-ad9107144300 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:20.301714 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-98c520a6-eeb9-4efe-831d-ad9107144300 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:20.310381 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-98c520a6-eeb9-4efe-831d-ad9107144300 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1362 microversion: 2.1 time: 0.238642 Nov 21 13:52:20.311307 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 46/97] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:20 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:20.431043 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-b79dc846-86dd-4e20-8b77-dfc99c91c9f6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:20.431971 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-b79dc846-86dd-4e20-8b77-dfc99c91c9f6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:20.438797 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b79dc846-86dd-4e20-8b77-dfc99c91c9f6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:20.439245 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b79dc846-86dd-4e20-8b77-dfc99c91c9f6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:20.440459 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b79dc846-86dd-4e20-8b77-dfc99c91c9f6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:20.440895 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b79dc846-86dd-4e20-8b77-dfc99c91c9f6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:20.590473 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-a05798cf-4a03-4d0f-bd46-f0ddc3c26bca tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:20.590986 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-a05798cf-4a03-4d0f-bd46-f0ddc3c26bca tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:20.596903 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a05798cf-4a03-4d0f-bd46-f0ddc3c26bca tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:20.597887 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a05798cf-4a03-4d0f-bd46-f0ddc3c26bca tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:20.598657 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a05798cf-4a03-4d0f-bd46-f0ddc3c26bca tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:20.599089 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a05798cf-4a03-4d0f-bd46-f0ddc3c26bca tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:20.644434 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-b79dc846-86dd-4e20-8b77-dfc99c91c9f6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:20.652009 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-b79dc846-86dd-4e20-8b77-dfc99c91c9f6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.225043 Nov 21 13:52:20.652581 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 52/98] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:20 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:20.731520 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-a05798cf-4a03-4d0f-bd46-f0ddc3c26bca tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:20.739371 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-a05798cf-4a03-4d0f-bd46-f0ddc3c26bca tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1314 microversion: 2.1 time: 0.152635 Nov 21 13:52:20.739954 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 47/99] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:20 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:20.878544 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-423f61f9-ddfc-4f7f-90f3-7010e469af56 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:20.879095 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-423f61f9-ddfc-4f7f-90f3-7010e469af56 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:20.885004 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-423f61f9-ddfc-4f7f-90f3-7010e469af56 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:20.885462 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-423f61f9-ddfc-4f7f-90f3-7010e469af56 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:20.886242 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-423f61f9-ddfc-4f7f-90f3-7010e469af56 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:20.886686 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-423f61f9-ddfc-4f7f-90f3-7010e469af56 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:21.015882 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-423f61f9-ddfc-4f7f-90f3-7010e469af56 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:21.024052 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-423f61f9-ddfc-4f7f-90f3-7010e469af56 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:21.025543 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-423f61f9-ddfc-4f7f-90f3-7010e469af56 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:21.026640 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-423f61f9-ddfc-4f7f-90f3-7010e469af56 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.152137 Nov 21 13:52:21.027193 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 53/100] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:20 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:21.327205 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-8c96a653-90c2-4bbf-8d0d-5327c094b375 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:21.327828 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-8c96a653-90c2-4bbf-8d0d-5327c094b375 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:21.334283 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8c96a653-90c2-4bbf-8d0d-5327c094b375 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:21.334727 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8c96a653-90c2-4bbf-8d0d-5327c094b375 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:21.335492 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8c96a653-90c2-4bbf-8d0d-5327c094b375 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:21.335955 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8c96a653-90c2-4bbf-8d0d-5327c094b375 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:21.462305 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-8c96a653-90c2-4bbf-8d0d-5327c094b375 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:21.469458 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-8c96a653-90c2-4bbf-8d0d-5327c094b375 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1362 microversion: 2.1 time: 0.145891 Nov 21 13:52:21.470013 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 48/101] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:21 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:21.668187 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-1a4d1151-c656-4008-9ea8-3064fd78f1c5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:21.668834 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-1a4d1151-c656-4008-9ea8-3064fd78f1c5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:21.674704 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1a4d1151-c656-4008-9ea8-3064fd78f1c5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:21.675159 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1a4d1151-c656-4008-9ea8-3064fd78f1c5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:21.676495 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1a4d1151-c656-4008-9ea8-3064fd78f1c5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:21.676936 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1a4d1151-c656-4008-9ea8-3064fd78f1c5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:21.761785 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-515df84b-fbd9-4041-a092-faa65da54ea5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:21.762499 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-515df84b-fbd9-4041-a092-faa65da54ea5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:21.768688 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-515df84b-fbd9-4041-a092-faa65da54ea5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:21.769138 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-515df84b-fbd9-4041-a092-faa65da54ea5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:21.769912 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-515df84b-fbd9-4041-a092-faa65da54ea5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:21.770347 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-515df84b-fbd9-4041-a092-faa65da54ea5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:21.807138 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-1a4d1151-c656-4008-9ea8-3064fd78f1c5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:21.814395 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-1a4d1151-c656-4008-9ea8-3064fd78f1c5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.149887 Nov 21 13:52:21.814964 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 54/102] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:21 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:21.902191 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-515df84b-fbd9-4041-a092-faa65da54ea5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:21.909368 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-515df84b-fbd9-4041-a092-faa65da54ea5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1314 microversion: 2.1 time: 0.151278 Nov 21 13:52:21.909917 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 49/103] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:21 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:22.045946 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-d8e42637-905b-492a-828d-69be07ff7893 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:22.046553 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-d8e42637-905b-492a-828d-69be07ff7893 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:22.053201 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d8e42637-905b-492a-828d-69be07ff7893 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:22.053650 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d8e42637-905b-492a-828d-69be07ff7893 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:22.054420 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d8e42637-905b-492a-828d-69be07ff7893 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:22.054850 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d8e42637-905b-492a-828d-69be07ff7893 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:22.185903 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-d8e42637-905b-492a-828d-69be07ff7893 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:22.193517 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-d8e42637-905b-492a-828d-69be07ff7893 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:22.195002 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-d8e42637-905b-492a-828d-69be07ff7893 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:22.196116 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-d8e42637-905b-492a-828d-69be07ff7893 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.154191 Nov 21 13:52:22.196670 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 55/104] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:22 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:22.485805 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-3636f1f4-349b-46dd-8486-13901fa03dee tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:22.486419 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3636f1f4-349b-46dd-8486-13901fa03dee tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:22.492537 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3636f1f4-349b-46dd-8486-13901fa03dee tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:22.492987 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3636f1f4-349b-46dd-8486-13901fa03dee tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:22.493760 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3636f1f4-349b-46dd-8486-13901fa03dee tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:22.494191 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3636f1f4-349b-46dd-8486-13901fa03dee tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:22.624146 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-3636f1f4-349b-46dd-8486-13901fa03dee tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:22.631609 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-3636f1f4-349b-46dd-8486-13901fa03dee tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1362 microversion: 2.1 time: 0.149457 Nov 21 13:52:22.632197 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 50/105] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:22 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:22.832143 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-262487b7-bac6-425c-9ad2-2d752e158972 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:22.832765 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-262487b7-bac6-425c-9ad2-2d752e158972 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:22.838642 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-262487b7-bac6-425c-9ad2-2d752e158972 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:22.839097 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-262487b7-bac6-425c-9ad2-2d752e158972 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:22.839899 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-262487b7-bac6-425c-9ad2-2d752e158972 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:22.840340 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-262487b7-bac6-425c-9ad2-2d752e158972 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:22.925676 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-167f25b5-3c89-4852-833b-4cc1c79506fc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:22.926271 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-167f25b5-3c89-4852-833b-4cc1c79506fc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:22.931972 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-167f25b5-3c89-4852-833b-4cc1c79506fc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:22.932421 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-167f25b5-3c89-4852-833b-4cc1c79506fc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:22.933186 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-167f25b5-3c89-4852-833b-4cc1c79506fc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:22.933615 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-167f25b5-3c89-4852-833b-4cc1c79506fc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:22.966035 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-262487b7-bac6-425c-9ad2-2d752e158972 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:22.973209 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-262487b7-bac6-425c-9ad2-2d752e158972 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.145352 Nov 21 13:52:22.973776 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 56/106] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:22 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:23.058435 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-167f25b5-3c89-4852-833b-4cc1c79506fc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:23.065601 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-167f25b5-3c89-4852-833b-4cc1c79506fc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1314 microversion: 2.1 time: 0.143537 Nov 21 13:52:23.066687 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 51/107] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:22 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:23.212978 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-3245234a-4fae-47ff-98ce-1d7b1e966ee3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:23.213577 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-3245234a-4fae-47ff-98ce-1d7b1e966ee3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:23.219299 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3245234a-4fae-47ff-98ce-1d7b1e966ee3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:23.219744 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3245234a-4fae-47ff-98ce-1d7b1e966ee3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:23.220533 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3245234a-4fae-47ff-98ce-1d7b1e966ee3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:23.220963 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3245234a-4fae-47ff-98ce-1d7b1e966ee3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:23.349455 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-3245234a-4fae-47ff-98ce-1d7b1e966ee3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:23.357036 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-3245234a-4fae-47ff-98ce-1d7b1e966ee3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:23.358536 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-3245234a-4fae-47ff-98ce-1d7b1e966ee3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:23.359636 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-3245234a-4fae-47ff-98ce-1d7b1e966ee3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.150295 Nov 21 13:52:23.360217 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 57/108] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:23 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:23.649304 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-07a2e145-ba33-4aaf-a788-02da62217b09 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:23.650574 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-07a2e145-ba33-4aaf-a788-02da62217b09 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:23.656996 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-07a2e145-ba33-4aaf-a788-02da62217b09 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:23.657714 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-07a2e145-ba33-4aaf-a788-02da62217b09 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:23.658704 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-07a2e145-ba33-4aaf-a788-02da62217b09 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:23.659366 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-07a2e145-ba33-4aaf-a788-02da62217b09 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:23.812343 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-07a2e145-ba33-4aaf-a788-02da62217b09 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:23.823660 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-07a2e145-ba33-4aaf-a788-02da62217b09 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1362 microversion: 2.1 time: 0.178359 Nov 21 13:52:23.824699 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 52/109] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:23 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:23.990131 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c90fd72c-6c91-43d1-8a63-dbab8c021151 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:23.990740 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-c90fd72c-6c91-43d1-8a63-dbab8c021151 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:23.996746 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c90fd72c-6c91-43d1-8a63-dbab8c021151 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:23.997191 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c90fd72c-6c91-43d1-8a63-dbab8c021151 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:23.997958 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c90fd72c-6c91-43d1-8a63-dbab8c021151 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:23.998387 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c90fd72c-6c91-43d1-8a63-dbab8c021151 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:24.084330 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b891234b-2a7c-4e3b-93de-db19bf2010c4 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:24.084948 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b891234b-2a7c-4e3b-93de-db19bf2010c4 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:24.091003 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b891234b-2a7c-4e3b-93de-db19bf2010c4 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:24.091456 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b891234b-2a7c-4e3b-93de-db19bf2010c4 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:24.092269 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b891234b-2a7c-4e3b-93de-db19bf2010c4 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:24.092707 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b891234b-2a7c-4e3b-93de-db19bf2010c4 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:24.130378 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-c90fd72c-6c91-43d1-8a63-dbab8c021151 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:24.138196 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c90fd72c-6c91-43d1-8a63-dbab8c021151 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.152107 Nov 21 13:52:24.147657 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 58/110] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:23 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:24.226342 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-b891234b-2a7c-4e3b-93de-db19bf2010c4 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:24.233687 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-b891234b-2a7c-4e3b-93de-db19bf2010c4 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1314 microversion: 2.1 time: 0.153433 Nov 21 13:52:24.234261 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 53/111] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:24 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:24.383703 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-dece38f4-45ba-4b8a-9796-5c64e45f3f8b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:24.384350 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-dece38f4-45ba-4b8a-9796-5c64e45f3f8b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:24.390337 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dece38f4-45ba-4b8a-9796-5c64e45f3f8b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:24.390801 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dece38f4-45ba-4b8a-9796-5c64e45f3f8b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:24.391599 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dece38f4-45ba-4b8a-9796-5c64e45f3f8b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:24.392075 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dece38f4-45ba-4b8a-9796-5c64e45f3f8b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:24.527503 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-dece38f4-45ba-4b8a-9796-5c64e45f3f8b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:24.535264 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-dece38f4-45ba-4b8a-9796-5c64e45f3f8b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:24.536839 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-dece38f4-45ba-4b8a-9796-5c64e45f3f8b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:24.537942 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-dece38f4-45ba-4b8a-9796-5c64e45f3f8b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.163428 Nov 21 13:52:24.538509 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 59/112] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:24 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:24.841192 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-d2af6b22-3084-4288-80b7-102735a7f9e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:24.841898 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-d2af6b22-3084-4288-80b7-102735a7f9e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:24.847780 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d2af6b22-3084-4288-80b7-102735a7f9e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:24.848262 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d2af6b22-3084-4288-80b7-102735a7f9e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:24.849118 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d2af6b22-3084-4288-80b7-102735a7f9e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:24.849646 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d2af6b22-3084-4288-80b7-102735a7f9e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:24.978982 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-d2af6b22-3084-4288-80b7-102735a7f9e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:24.986156 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-d2af6b22-3084-4288-80b7-102735a7f9e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1362 microversion: 2.1 time: 0.148846 Nov 21 13:52:24.986723 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 54/113] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:24 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:25.155136 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-19785869-1981-4308-9012-4c630edf6146 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:25.156545 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-19785869-1981-4308-9012-4c630edf6146 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:25.163187 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-19785869-1981-4308-9012-4c630edf6146 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:25.163650 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-19785869-1981-4308-9012-4c630edf6146 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:25.164476 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-19785869-1981-4308-9012-4c630edf6146 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:25.164919 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-19785869-1981-4308-9012-4c630edf6146 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:25.250122 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-fba1b7fa-5c4c-48d6-9b86-8ea2297ad594 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:25.250728 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-fba1b7fa-5c4c-48d6-9b86-8ea2297ad594 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:25.256942 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fba1b7fa-5c4c-48d6-9b86-8ea2297ad594 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:25.257390 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fba1b7fa-5c4c-48d6-9b86-8ea2297ad594 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:25.258166 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fba1b7fa-5c4c-48d6-9b86-8ea2297ad594 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:25.258600 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fba1b7fa-5c4c-48d6-9b86-8ea2297ad594 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:25.293167 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-19785869-1981-4308-9012-4c630edf6146 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:25.301042 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-19785869-1981-4308-9012-4c630edf6146 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.148923 Nov 21 13:52:25.301616 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 60/114] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:25 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:25.389336 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-fba1b7fa-5c4c-48d6-9b86-8ea2297ad594 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:25.397303 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-fba1b7fa-5c4c-48d6-9b86-8ea2297ad594 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1314 microversion: 2.1 time: 0.150732 Nov 21 13:52:25.397870 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 55/115] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:25 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:25.555371 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-79396674-468b-45e5-9216-1af375e81e1f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:25.556014 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-79396674-468b-45e5-9216-1af375e81e1f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:25.561841 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-79396674-468b-45e5-9216-1af375e81e1f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:25.562273 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-79396674-468b-45e5-9216-1af375e81e1f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:25.563034 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-79396674-468b-45e5-9216-1af375e81e1f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:25.563459 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-79396674-468b-45e5-9216-1af375e81e1f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:25.692975 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-79396674-468b-45e5-9216-1af375e81e1f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:25.700613 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-79396674-468b-45e5-9216-1af375e81e1f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:25.702114 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-79396674-468b-45e5-9216-1af375e81e1f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:25.703212 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-79396674-468b-45e5-9216-1af375e81e1f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.151457 Nov 21 13:52:25.703824 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 61/116] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:25 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:26.003920 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-701f1258-b5be-4b13-824a-d89836c581c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:26.004494 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-701f1258-b5be-4b13-824a-d89836c581c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:26.010241 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-701f1258-b5be-4b13-824a-d89836c581c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:26.010690 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-701f1258-b5be-4b13-824a-d89836c581c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:26.011463 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-701f1258-b5be-4b13-824a-d89836c581c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:26.011930 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-701f1258-b5be-4b13-824a-d89836c581c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:26.138306 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-701f1258-b5be-4b13-824a-d89836c581c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:26.145999 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-701f1258-b5be-4b13-824a-d89836c581c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1362 microversion: 2.1 time: 0.146706 Nov 21 13:52:26.146562 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 56/117] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:25 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:26.317986 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-11647eb3-e25e-4728-867b-89ca3112d993 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:26.318601 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-11647eb3-e25e-4728-867b-89ca3112d993 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:26.324557 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-11647eb3-e25e-4728-867b-89ca3112d993 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:26.325008 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-11647eb3-e25e-4728-867b-89ca3112d993 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:26.325785 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-11647eb3-e25e-4728-867b-89ca3112d993 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:26.326223 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-11647eb3-e25e-4728-867b-89ca3112d993 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:26.413612 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-353f5ca9-7646-4a35-b608-fb671e0ff829 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:26.414242 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-353f5ca9-7646-4a35-b608-fb671e0ff829 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:26.420022 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-353f5ca9-7646-4a35-b608-fb671e0ff829 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:26.420482 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-353f5ca9-7646-4a35-b608-fb671e0ff829 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:26.421275 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-353f5ca9-7646-4a35-b608-fb671e0ff829 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:26.421713 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-353f5ca9-7646-4a35-b608-fb671e0ff829 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:26.456697 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-11647eb3-e25e-4728-867b-89ca3112d993 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:26.464108 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-11647eb3-e25e-4728-867b-89ca3112d993 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.150320 Nov 21 13:52:26.464685 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 62/118] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:26 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:26.557818 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-353f5ca9-7646-4a35-b608-fb671e0ff829 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:26.565219 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-353f5ca9-7646-4a35-b608-fb671e0ff829 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1314 microversion: 2.1 time: 0.155295 Nov 21 13:52:26.565797 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 57/119] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:26 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:26.721238 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-62838225-0d7d-4511-905b-40ff9bbf550e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:26.721851 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-62838225-0d7d-4511-905b-40ff9bbf550e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:26.728342 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-62838225-0d7d-4511-905b-40ff9bbf550e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:26.728804 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-62838225-0d7d-4511-905b-40ff9bbf550e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:26.729589 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-62838225-0d7d-4511-905b-40ff9bbf550e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:26.730015 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-62838225-0d7d-4511-905b-40ff9bbf550e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:27.120154 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-62838225-0d7d-4511-905b-40ff9bbf550e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:27.128516 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-62838225-0d7d-4511-905b-40ff9bbf550e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:27.130086 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-62838225-0d7d-4511-905b-40ff9bbf550e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:27.131256 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-62838225-0d7d-4511-905b-40ff9bbf550e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.413690 Nov 21 13:52:27.131905 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 63/120] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:26 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:27.162872 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b556add7-eb8a-4a65-9826-2afe0efaff7d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:27.163476 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b556add7-eb8a-4a65-9826-2afe0efaff7d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:27.169207 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b556add7-eb8a-4a65-9826-2afe0efaff7d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:27.169646 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b556add7-eb8a-4a65-9826-2afe0efaff7d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:27.170410 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b556add7-eb8a-4a65-9826-2afe0efaff7d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:27.170837 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b556add7-eb8a-4a65-9826-2afe0efaff7d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:27.303541 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-b556add7-eb8a-4a65-9826-2afe0efaff7d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:27.310761 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-b556add7-eb8a-4a65-9826-2afe0efaff7d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1362 microversion: 2.1 time: 0.152297 Nov 21 13:52:27.311328 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 58/121] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:27 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:27.482667 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-91596c9c-5568-4b11-bc39-c9d2e5f31994 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:27.483328 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-91596c9c-5568-4b11-bc39-c9d2e5f31994 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:27.489221 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-91596c9c-5568-4b11-bc39-c9d2e5f31994 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:27.489675 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-91596c9c-5568-4b11-bc39-c9d2e5f31994 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:27.490452 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-91596c9c-5568-4b11-bc39-c9d2e5f31994 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:27.490884 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-91596c9c-5568-4b11-bc39-c9d2e5f31994 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:27.582718 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-72be7545-4161-488f-899e-2ab3bc93bd99 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:27.583550 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-72be7545-4161-488f-899e-2ab3bc93bd99 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:27.590349 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-72be7545-4161-488f-899e-2ab3bc93bd99 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:27.590864 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-72be7545-4161-488f-899e-2ab3bc93bd99 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:27.591657 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-72be7545-4161-488f-899e-2ab3bc93bd99 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:27.592123 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-72be7545-4161-488f-899e-2ab3bc93bd99 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:27.641230 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-91596c9c-5568-4b11-bc39-c9d2e5f31994 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:27.649160 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-91596c9c-5568-4b11-bc39-c9d2e5f31994 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.172370 Nov 21 13:52:27.649815 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 64/122] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:27 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:27.730298 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-72be7545-4161-488f-899e-2ab3bc93bd99 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:27.742118 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-72be7545-4161-488f-899e-2ab3bc93bd99 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1314 microversion: 2.1 time: 0.163751 Nov 21 13:52:27.742711 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 59/123] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:27 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:28.149037 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-2e1108a9-b1f4-469c-ba05-f8683ebfae5a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:28.149651 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-2e1108a9-b1f4-469c-ba05-f8683ebfae5a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:28.155811 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2e1108a9-b1f4-469c-ba05-f8683ebfae5a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:28.156295 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2e1108a9-b1f4-469c-ba05-f8683ebfae5a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:28.157071 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2e1108a9-b1f4-469c-ba05-f8683ebfae5a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:28.157531 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2e1108a9-b1f4-469c-ba05-f8683ebfae5a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:28.281404 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2e1108a9-b1f4-469c-ba05-f8683ebfae5a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:28.290562 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2e1108a9-b1f4-469c-ba05-f8683ebfae5a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:28.292845 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2e1108a9-b1f4-469c-ba05-f8683ebfae5a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:28.293959 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-2e1108a9-b1f4-469c-ba05-f8683ebfae5a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.148769 Nov 21 13:52:28.294537 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 65/124] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:28 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:28.327066 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-87a362fe-0c23-4808-bd11-ad339bfe523a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:28.327721 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-87a362fe-0c23-4808-bd11-ad339bfe523a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:28.333638 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-87a362fe-0c23-4808-bd11-ad339bfe523a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:28.334078 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-87a362fe-0c23-4808-bd11-ad339bfe523a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:28.334838 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-87a362fe-0c23-4808-bd11-ad339bfe523a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:28.335311 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-87a362fe-0c23-4808-bd11-ad339bfe523a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:28.461531 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-87a362fe-0c23-4808-bd11-ad339bfe523a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:28.468650 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-87a362fe-0c23-4808-bd11-ad339bfe523a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1362 microversion: 2.1 time: 0.145170 Nov 21 13:52:28.469247 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 60/125] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:28 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:28.665584 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-34077333-90c3-492c-8c92-7f7e1e0d64ed tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:28.666201 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-34077333-90c3-492c-8c92-7f7e1e0d64ed tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:28.671978 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-34077333-90c3-492c-8c92-7f7e1e0d64ed tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:28.672436 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-34077333-90c3-492c-8c92-7f7e1e0d64ed tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:28.673215 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-34077333-90c3-492c-8c92-7f7e1e0d64ed tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:28.673649 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-34077333-90c3-492c-8c92-7f7e1e0d64ed tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:28.758524 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-e9ffc91d-1a18-415d-91f3-d6030877b339 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:28.759152 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-e9ffc91d-1a18-415d-91f3-d6030877b339 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:28.765422 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e9ffc91d-1a18-415d-91f3-d6030877b339 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:28.765877 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e9ffc91d-1a18-415d-91f3-d6030877b339 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:28.766854 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e9ffc91d-1a18-415d-91f3-d6030877b339 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:28.767293 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e9ffc91d-1a18-415d-91f3-d6030877b339 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:28.902980 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-e9ffc91d-1a18-415d-91f3-d6030877b339 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:28.910688 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-e9ffc91d-1a18-415d-91f3-d6030877b339 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1314 microversion: 2.1 time: 0.155811 Nov 21 13:52:28.911286 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 61/126] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:28 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:28.982768 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-34077333-90c3-492c-8c92-7f7e1e0d64ed tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:28.990019 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-34077333-90c3-492c-8c92-7f7e1e0d64ed tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.327990 Nov 21 13:52:28.990582 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 66/127] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:28 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:29.313553 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2172f108-b384-4cce-b378-8a2e3cf875cc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:29.314163 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-2172f108-b384-4cce-b378-8a2e3cf875cc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:29.325829 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2172f108-b384-4cce-b378-8a2e3cf875cc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:29.326283 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2172f108-b384-4cce-b378-8a2e3cf875cc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:29.327097 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2172f108-b384-4cce-b378-8a2e3cf875cc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:29.327710 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2172f108-b384-4cce-b378-8a2e3cf875cc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:29.462105 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-2172f108-b384-4cce-b378-8a2e3cf875cc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:29.469733 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-2172f108-b384-4cce-b378-8a2e3cf875cc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:29.471218 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-2172f108-b384-4cce-b378-8a2e3cf875cc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:29.472874 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-2172f108-b384-4cce-b378-8a2e3cf875cc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.162555 Nov 21 13:52:29.473435 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 62/128] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:29 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:29.485426 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c8e841ab-5c1c-46fb-8113-6291c8083fd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:29.486027 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-c8e841ab-5c1c-46fb-8113-6291c8083fd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:29.491783 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c8e841ab-5c1c-46fb-8113-6291c8083fd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:29.492255 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c8e841ab-5c1c-46fb-8113-6291c8083fd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:29.493022 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c8e841ab-5c1c-46fb-8113-6291c8083fd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:29.493456 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c8e841ab-5c1c-46fb-8113-6291c8083fd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:29.619726 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-c8e841ab-5c1c-46fb-8113-6291c8083fd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:29.627145 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c8e841ab-5c1c-46fb-8113-6291c8083fd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1362 microversion: 2.1 time: 0.145317 Nov 21 13:52:29.628020 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 67/129] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:29 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:29.927895 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-283c49b1-2b7a-4542-a954-8267dd04d1ac tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:29.928457 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-283c49b1-2b7a-4542-a954-8267dd04d1ac tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:29.934359 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-283c49b1-2b7a-4542-a954-8267dd04d1ac tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:29.934802 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-283c49b1-2b7a-4542-a954-8267dd04d1ac tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:29.935565 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-283c49b1-2b7a-4542-a954-8267dd04d1ac tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:29.936029 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-283c49b1-2b7a-4542-a954-8267dd04d1ac tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:30.007143 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-55670e98-a73a-4754-922f-1ac38e6cd41f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:30.007747 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-55670e98-a73a-4754-922f-1ac38e6cd41f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:30.013497 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-55670e98-a73a-4754-922f-1ac38e6cd41f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:30.013867 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-55670e98-a73a-4754-922f-1ac38e6cd41f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:30.014642 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-55670e98-a73a-4754-922f-1ac38e6cd41f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:30.015074 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-55670e98-a73a-4754-922f-1ac38e6cd41f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:30.062201 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-283c49b1-2b7a-4542-a954-8267dd04d1ac tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:30.070063 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-283c49b1-2b7a-4542-a954-8267dd04d1ac tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1314 microversion: 2.1 time: 0.146390 Nov 21 13:52:30.070629 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 63/130] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:29 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:30.143676 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-55670e98-a73a-4754-922f-1ac38e6cd41f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:30.152052 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-55670e98-a73a-4754-922f-1ac38e6cd41f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.149343 Nov 21 13:52:30.152627 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 68/131] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:30 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:30.491011 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-d1851583-5675-4744-99d1-82fe2c16d278 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:30.491610 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-d1851583-5675-4744-99d1-82fe2c16d278 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:30.497731 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d1851583-5675-4744-99d1-82fe2c16d278 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:30.498329 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d1851583-5675-4744-99d1-82fe2c16d278 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:30.499235 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d1851583-5675-4744-99d1-82fe2c16d278 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:30.499670 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d1851583-5675-4744-99d1-82fe2c16d278 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:30.634788 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-d1851583-5675-4744-99d1-82fe2c16d278 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:30.643128 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-d1851583-5675-4744-99d1-82fe2c16d278 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:30.644936 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-60991bff-e319-44ab-8b4d-ae9dc63c7200 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:30.645221 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-d1851583-5675-4744-99d1-82fe2c16d278 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:30.645542 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-60991bff-e319-44ab-8b4d-ae9dc63c7200 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:30.646927 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-d1851583-5675-4744-99d1-82fe2c16d278 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.160198 Nov 21 13:52:30.647481 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 64/132] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:30 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:30.651536 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-60991bff-e319-44ab-8b4d-ae9dc63c7200 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:30.652025 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-60991bff-e319-44ab-8b4d-ae9dc63c7200 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:30.652805 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-60991bff-e319-44ab-8b4d-ae9dc63c7200 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:30.653240 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-60991bff-e319-44ab-8b4d-ae9dc63c7200 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:30.806620 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-60991bff-e319-44ab-8b4d-ae9dc63c7200 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:30.814781 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-60991bff-e319-44ab-8b4d-ae9dc63c7200 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1362 microversion: 2.1 time: 0.174037 Nov 21 13:52:30.815508 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 69/133] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:30 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:31.086752 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-9b2aa003-f763-4ac4-a7f0-bbe3fc5ab524 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:31.087317 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-9b2aa003-f763-4ac4-a7f0-bbe3fc5ab524 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:31.094732 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9b2aa003-f763-4ac4-a7f0-bbe3fc5ab524 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:31.095291 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9b2aa003-f763-4ac4-a7f0-bbe3fc5ab524 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:31.096237 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9b2aa003-f763-4ac4-a7f0-bbe3fc5ab524 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:31.096741 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9b2aa003-f763-4ac4-a7f0-bbe3fc5ab524 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:31.173179 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ecd64424-540f-4079-88b4-9aa459a2e17c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:31.174584 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ecd64424-540f-4079-88b4-9aa459a2e17c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:31.182753 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ecd64424-540f-4079-88b4-9aa459a2e17c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:31.183612 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ecd64424-540f-4079-88b4-9aa459a2e17c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:31.184828 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ecd64424-540f-4079-88b4-9aa459a2e17c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:31.185760 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ecd64424-540f-4079-88b4-9aa459a2e17c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:31.341209 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-9b2aa003-f763-4ac4-a7f0-bbe3fc5ab524 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:31.349708 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-9b2aa003-f763-4ac4-a7f0-bbe3fc5ab524 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1501 microversion: 2.1 time: 0.266708 Nov 21 13:52:31.352022 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 65/134] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:31 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1501 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:31.368264 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-36ba109e-c35a-445f-9f9e-a91855264580 req-b28d263d-6cba-4420-8ae0-11a5d2da61e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa7ec26-0d3e-4d40-87d2-45e63ed435eb", "name": "network-vif-plugged", "status": "completed", "tag": "e97fd0d3-216a-4615-aa4a-a98857cba123"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:31.371483 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:52:31.371483 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:52:31.396662 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-36ba109e-c35a-445f-9f9e-a91855264580 req-b28d263d-6cba-4420-8ae0-11a5d2da61e3 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:31.402013 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-36ba109e-c35a-445f-9f9e-a91855264580 req-b28d263d-6cba-4420-8ae0-11a5d2da61e3 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:31.418522 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-36ba109e-c35a-445f-9f9e-a91855264580 req-b28d263d-6cba-4420-8ae0-11a5d2da61e3 service nova] Creating event network-vif-plugged:e97fd0d3-216a-4615-aa4a-a98857cba123 for instance 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb on hv-cinder-76845 Nov 21 13:52:31.454365 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ecd64424-540f-4079-88b4-9aa459a2e17c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:31.466709 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ecd64424-540f-4079-88b4-9aa459a2e17c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.301740 Nov 21 13:52:31.468531 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-36ba109e-c35a-445f-9f9e-a91855264580 req-b28d263d-6cba-4420-8ae0-11a5d2da61e3 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114809 Nov 21 13:52:31.470546 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 66/135] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:52:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:52:31.480851 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 70/136] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:31 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:31.677983 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-0ef5665f-6a9c-4799-93d1-0a78ea1079c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:31.681027 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-0ef5665f-6a9c-4799-93d1-0a78ea1079c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:31.693931 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0ef5665f-6a9c-4799-93d1-0a78ea1079c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:31.694381 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0ef5665f-6a9c-4799-93d1-0a78ea1079c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:31.702854 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0ef5665f-6a9c-4799-93d1-0a78ea1079c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:31.703552 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0ef5665f-6a9c-4799-93d1-0a78ea1079c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:31.834133 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-2dd0a9e0-7a79-4eac-8571-9af4d8006222 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:31.835479 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-2dd0a9e0-7a79-4eac-8571-9af4d8006222 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:31.842717 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2dd0a9e0-7a79-4eac-8571-9af4d8006222 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:31.843425 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2dd0a9e0-7a79-4eac-8571-9af4d8006222 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:31.853691 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2dd0a9e0-7a79-4eac-8571-9af4d8006222 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:31.854506 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2dd0a9e0-7a79-4eac-8571-9af4d8006222 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:31.884761 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-0ef5665f-6a9c-4799-93d1-0a78ea1079c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:31.892593 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-0ef5665f-6a9c-4799-93d1-0a78ea1079c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:31.894136 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-0ef5665f-6a9c-4799-93d1-0a78ea1079c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:31.895237 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-0ef5665f-6a9c-4799-93d1-0a78ea1079c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.233789 Nov 21 13:52:31.896306 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 67/137] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:31 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:32.038109 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2dd0a9e0-7a79-4eac-8571-9af4d8006222 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:32.046232 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-2dd0a9e0-7a79-4eac-8571-9af4d8006222 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1362 microversion: 2.1 time: 0.216053 Nov 21 13:52:32.046861 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 71/138] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:31 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:32.496918 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-a689a25b-8eb3-4b85-a734-49d7a66fd18a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:32.497520 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-a689a25b-8eb3-4b85-a734-49d7a66fd18a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:32.503667 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a689a25b-8eb3-4b85-a734-49d7a66fd18a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:32.504150 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a689a25b-8eb3-4b85-a734-49d7a66fd18a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:32.504916 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a689a25b-8eb3-4b85-a734-49d7a66fd18a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:32.505348 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a689a25b-8eb3-4b85-a734-49d7a66fd18a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:32.642415 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-a689a25b-8eb3-4b85-a734-49d7a66fd18a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:32.650188 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-a689a25b-8eb3-4b85-a734-49d7a66fd18a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.156888 Nov 21 13:52:32.650741 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 68/139] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:32 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:32.833557 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-0cbe97b0-2165-493b-9e5e-db3944b3bf17 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d45513f-92e2-421d-8175-a24ecfcec1d2"}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:32.834669 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-0cbe97b0-2165-493b-9e5e-db3944b3bf17 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:32.840518 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0cbe97b0-2165-493b-9e5e-db3944b3bf17 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:32.840961 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0cbe97b0-2165-493b-9e5e-db3944b3bf17 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:32.841727 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0cbe97b0-2165-493b-9e5e-db3944b3bf17 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:32.842156 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0cbe97b0-2165-493b-9e5e-db3944b3bf17 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:32.913191 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-a19ed7cc-3872-4ece-85aa-dd26996da106 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:32.913797 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-a19ed7cc-3872-4ece-85aa-dd26996da106 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:32.919665 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a19ed7cc-3872-4ece-85aa-dd26996da106 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:32.920136 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a19ed7cc-3872-4ece-85aa-dd26996da106 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:32.920905 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a19ed7cc-3872-4ece-85aa-dd26996da106 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:32.921328 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a19ed7cc-3872-4ece-85aa-dd26996da106 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:33.047502 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-a19ed7cc-3872-4ece-85aa-dd26996da106 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:33.055627 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-a19ed7cc-3872-4ece-85aa-dd26996da106 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:33.057149 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-a19ed7cc-3872-4ece-85aa-dd26996da106 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:33.058236 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-a19ed7cc-3872-4ece-85aa-dd26996da106 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.148711 Nov 21 13:52:33.058798 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 69/140] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:32 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 13:52:33.063507 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-fbfe1ae3-5db6-4135-9745-071aee9de13f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:33.064153 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-fbfe1ae3-5db6-4135-9745-071aee9de13f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:33.070351 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fbfe1ae3-5db6-4135-9745-071aee9de13f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:33.070791 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fbfe1ae3-5db6-4135-9745-071aee9de13f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:33.071551 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fbfe1ae3-5db6-4135-9745-071aee9de13f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:33.072008 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fbfe1ae3-5db6-4135-9745-071aee9de13f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:33.206499 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-fbfe1ae3-5db6-4135-9745-071aee9de13f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:33.213922 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-fbfe1ae3-5db6-4135-9745-071aee9de13f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1362 microversion: 2.1 time: 0.153447 Nov 21 13:52:33.214450 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 70/141] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:33 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:33.666348 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b9028b3c-43a0-400e-9d6c-7885e4a1864c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:33.666996 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b9028b3c-43a0-400e-9d6c-7885e4a1864c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:33.672946 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b9028b3c-43a0-400e-9d6c-7885e4a1864c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:33.673340 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b9028b3c-43a0-400e-9d6c-7885e4a1864c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:33.674117 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b9028b3c-43a0-400e-9d6c-7885e4a1864c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:33.674552 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b9028b3c-43a0-400e-9d6c-7885e4a1864c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:33.802019 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-b9028b3c-43a0-400e-9d6c-7885e4a1864c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:33.809125 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-b9028b3c-43a0-400e-9d6c-7885e4a1864c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.146440 Nov 21 13:52:33.809704 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 71/142] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:33 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:34.076268 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-d699ec79-f162-4533-a7a7-8e1db1bd70d9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:34.076862 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-d699ec79-f162-4533-a7a7-8e1db1bd70d9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:34.083233 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d699ec79-f162-4533-a7a7-8e1db1bd70d9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:34.083676 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d699ec79-f162-4533-a7a7-8e1db1bd70d9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:34.084466 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d699ec79-f162-4533-a7a7-8e1db1bd70d9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:34.084892 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d699ec79-f162-4533-a7a7-8e1db1bd70d9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:34.212589 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-d699ec79-f162-4533-a7a7-8e1db1bd70d9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:34.220535 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-d699ec79-f162-4533-a7a7-8e1db1bd70d9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:34.222736 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-d699ec79-f162-4533-a7a7-8e1db1bd70d9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:34.223858 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-d699ec79-f162-4533-a7a7-8e1db1bd70d9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.151186 Nov 21 13:52:34.224585 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 72/143] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:34 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 13:52:34.239783 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b706b615-fc7c-4df4-a2cc-def01f2fece0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:34.240430 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b706b615-fc7c-4df4-a2cc-def01f2fece0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:34.246413 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b706b615-fc7c-4df4-a2cc-def01f2fece0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:34.248605 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b706b615-fc7c-4df4-a2cc-def01f2fece0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:34.248605 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b706b615-fc7c-4df4-a2cc-def01f2fece0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:34.248605 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b706b615-fc7c-4df4-a2cc-def01f2fece0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:34.385945 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-b706b615-fc7c-4df4-a2cc-def01f2fece0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:34.393385 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-b706b615-fc7c-4df4-a2cc-def01f2fece0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1362 microversion: 2.1 time: 0.166779 Nov 21 13:52:34.394484 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 73/144] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:34 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:34.406708 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-752c6a73-f2bf-4d36-a120-731413b8328e req-cb7529f8-7374-40c7-8a38-413029b52259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d1c9d3d-f088-4d2f-b2bc-e26543509aae", "name": "network-vif-plugged", "status": "completed", "tag": "e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:34.408780 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:52:34.408780 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:52:34.415589 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-752c6a73-f2bf-4d36-a120-731413b8328e req-cb7529f8-7374-40c7-8a38-413029b52259 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:34.416091 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-752c6a73-f2bf-4d36-a120-731413b8328e req-cb7529f8-7374-40c7-8a38-413029b52259 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:34.426865 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-752c6a73-f2bf-4d36-a120-731413b8328e req-cb7529f8-7374-40c7-8a38-413029b52259 service nova] Creating event network-vif-plugged:e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 for instance 2d1c9d3d-f088-4d2f-b2bc-e26543509aae on hv-cinder-76845 Nov 21 13:52:34.431663 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-752c6a73-f2bf-4d36-a120-731413b8328e req-cb7529f8-7374-40c7-8a38-413029b52259 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028392 Nov 21 13:52:34.432288 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 74/145] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:52:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:52:34.826489 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-508ff244-8f4e-4cc3-99ce-bb7431b6cee0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:34.827694 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-508ff244-8f4e-4cc3-99ce-bb7431b6cee0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:34.834693 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-508ff244-8f4e-4cc3-99ce-bb7431b6cee0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:34.835142 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-508ff244-8f4e-4cc3-99ce-bb7431b6cee0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:34.835945 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-508ff244-8f4e-4cc3-99ce-bb7431b6cee0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:34.836405 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-508ff244-8f4e-4cc3-99ce-bb7431b6cee0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:34.961724 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-508ff244-8f4e-4cc3-99ce-bb7431b6cee0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:34.968964 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-508ff244-8f4e-4cc3-99ce-bb7431b6cee0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.146981 Nov 21 13:52:34.969526 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 75/146] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:34 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:35.242070 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-e50db2a4-75ac-4334-b0e3-09965c44c1b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:35.243422 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-e50db2a4-75ac-4334-b0e3-09965c44c1b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:35.249525 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e50db2a4-75ac-4334-b0e3-09965c44c1b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:35.250007 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e50db2a4-75ac-4334-b0e3-09965c44c1b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:35.251015 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e50db2a4-75ac-4334-b0e3-09965c44c1b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:35.251510 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e50db2a4-75ac-4334-b0e3-09965c44c1b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:35.417266 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-e50db2a4-75ac-4334-b0e3-09965c44c1b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:35.425809 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-e50db2a4-75ac-4334-b0e3-09965c44c1b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:35.427574 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-e50db2a4-75ac-4334-b0e3-09965c44c1b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:35.428706 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-e50db2a4-75ac-4334-b0e3-09965c44c1b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.190447 Nov 21 13:52:35.439846 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 76/147] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:35 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 13:52:35.439937 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-0cbe97b0-2165-493b-9e5e-db3944b3bf17 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "POST /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.601785 Nov 21 13:52:35.439937 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 72/148] 10.222.0.11 () {60 vars in 1322 bytes} [Sun Nov 21 13:52:32 2021] POST /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b/os-volume_attachments => generated 194 bytes in 2603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:52:35.440362 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-5207074f-cd83-4b01-aa17-1ac4153dccb9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:35.440362 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-5207074f-cd83-4b01-aa17-1ac4153dccb9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:35.441323 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5207074f-cd83-4b01-aa17-1ac4153dccb9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:35.441901 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5207074f-cd83-4b01-aa17-1ac4153dccb9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:35.442633 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5207074f-cd83-4b01-aa17-1ac4153dccb9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:35.443073 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5207074f-cd83-4b01-aa17-1ac4153dccb9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:35.590315 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-5207074f-cd83-4b01-aa17-1ac4153dccb9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:35.599855 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-5207074f-cd83-4b01-aa17-1ac4153dccb9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1362 microversion: 2.1 time: 0.169574 Nov 21 13:52:35.600631 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 77/149] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:35 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:35.986520 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-725da3fe-7d9f-485e-87ba-dd1ec82d7a58 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:35.987295 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-725da3fe-7d9f-485e-87ba-dd1ec82d7a58 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:35.993768 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-725da3fe-7d9f-485e-87ba-dd1ec82d7a58 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:35.994223 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-725da3fe-7d9f-485e-87ba-dd1ec82d7a58 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:35.994998 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-725da3fe-7d9f-485e-87ba-dd1ec82d7a58 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:35.995429 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-725da3fe-7d9f-485e-87ba-dd1ec82d7a58 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:36.133961 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-725da3fe-7d9f-485e-87ba-dd1ec82d7a58 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:36.141847 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-725da3fe-7d9f-485e-87ba-dd1ec82d7a58 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.159261 Nov 21 13:52:36.142421 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 73/150] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:35 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:36.447241 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-7c9bdc09-b290-44a0-9a07-39fc14ce6013 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:36.447875 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-7c9bdc09-b290-44a0-9a07-39fc14ce6013 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:36.454069 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7c9bdc09-b290-44a0-9a07-39fc14ce6013 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:36.454519 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7c9bdc09-b290-44a0-9a07-39fc14ce6013 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:36.455295 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7c9bdc09-b290-44a0-9a07-39fc14ce6013 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:36.455723 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7c9bdc09-b290-44a0-9a07-39fc14ce6013 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:36.615557 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-7c9bdc09-b290-44a0-9a07-39fc14ce6013 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:36.616810 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-b279b90d-2a64-4047-867a-b2864a2bccce tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:36.617428 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-b279b90d-2a64-4047-867a-b2864a2bccce tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:36.624404 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b279b90d-2a64-4047-867a-b2864a2bccce tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:36.625850 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b279b90d-2a64-4047-867a-b2864a2bccce tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:36.626199 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-7c9bdc09-b290-44a0-9a07-39fc14ce6013 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:36.627002 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b279b90d-2a64-4047-867a-b2864a2bccce tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:36.627866 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b279b90d-2a64-4047-867a-b2864a2bccce tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:36.629481 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-7c9bdc09-b290-44a0-9a07-39fc14ce6013 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:36.630855 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-7c9bdc09-b290-44a0-9a07-39fc14ce6013 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.187433 Nov 21 13:52:36.632016 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 78/151] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:36 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:36.830078 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-b279b90d-2a64-4047-867a-b2864a2bccce tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:36.852860 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-b279b90d-2a64-4047-867a-b2864a2bccce tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1548 microversion: 2.1 time: 0.239705 Nov 21 13:52:36.854537 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 74/152] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:36 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1548 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:36.871930 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-33b7f6e3-7c49-418e-8100-26b28b50187f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:36.872825 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-33b7f6e3-7c49-418e-8100-26b28b50187f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:36.887346 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-33b7f6e3-7c49-418e-8100-26b28b50187f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:36.889156 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-33b7f6e3-7c49-418e-8100-26b28b50187f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:36.892029 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-33b7f6e3-7c49-418e-8100-26b28b50187f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:36.892730 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-33b7f6e3-7c49-418e-8100-26b28b50187f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:37.056554 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-33b7f6e3-7c49-418e-8100-26b28b50187f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188492 Nov 21 13:52:37.058151 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 79/153] 10.222.0.11 () {58 vars in 1274 bytes} [Sun Nov 21 13:52:36 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:52:37.160562 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-0225ae80-b3bd-44ea-83b0-c3c20948d5b0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:37.161628 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-0225ae80-b3bd-44ea-83b0-c3c20948d5b0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:37.170825 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0225ae80-b3bd-44ea-83b0-c3c20948d5b0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:37.171474 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0225ae80-b3bd-44ea-83b0-c3c20948d5b0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:37.172541 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0225ae80-b3bd-44ea-83b0-c3c20948d5b0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:37.173113 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0225ae80-b3bd-44ea-83b0-c3c20948d5b0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:37.483163 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-0225ae80-b3bd-44ea-83b0-c3c20948d5b0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:37.495090 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-0225ae80-b3bd-44ea-83b0-c3c20948d5b0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.339226 Nov 21 13:52:37.497808 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 75/154] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:37 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:37.510536 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-001eab61-1113-4f9b-bef8-58afb51ecacd req-f82d9211-80b0-4385-90ae-b111d4cf67a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6f04799-b287-41b6-9756-b259d5eeddeb", "name": "network-vif-plugged", "status": "completed", "tag": "dcf844c6-0002-4d63-9e63-4bf56191c807"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:37.512363 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:52:37.512363 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:52:37.521681 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-001eab61-1113-4f9b-bef8-58afb51ecacd req-f82d9211-80b0-4385-90ae-b111d4cf67a4 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:37.522544 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-001eab61-1113-4f9b-bef8-58afb51ecacd req-f82d9211-80b0-4385-90ae-b111d4cf67a4 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:37.549504 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-001eab61-1113-4f9b-bef8-58afb51ecacd req-f82d9211-80b0-4385-90ae-b111d4cf67a4 service nova] Creating event network-vif-plugged:dcf844c6-0002-4d63-9e63-4bf56191c807 for instance e6f04799-b287-41b6-9756-b259d5eeddeb on hv-cinder-76845 Nov 21 13:52:37.560103 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-001eab61-1113-4f9b-bef8-58afb51ecacd req-f82d9211-80b0-4385-90ae-b111d4cf67a4 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053381 Nov 21 13:52:37.565878 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 80/155] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:52:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:52:37.650643 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-d6eaab44-4b9e-40b4-b4b4-4221a13c0d98 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:37.651314 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-d6eaab44-4b9e-40b4-b4b4-4221a13c0d98 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:37.663167 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d6eaab44-4b9e-40b4-b4b4-4221a13c0d98 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:37.665463 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d6eaab44-4b9e-40b4-b4b4-4221a13c0d98 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:37.666801 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d6eaab44-4b9e-40b4-b4b4-4221a13c0d98 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:37.667251 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d6eaab44-4b9e-40b4-b4b4-4221a13c0d98 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:38.151606 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-d6eaab44-4b9e-40b4-b4b4-4221a13c0d98 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:38.164040 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-d6eaab44-4b9e-40b4-b4b4-4221a13c0d98 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:38.168500 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-d6eaab44-4b9e-40b4-b4b4-4221a13c0d98 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:38.169942 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-d6eaab44-4b9e-40b4-b4b4-4221a13c0d98 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.523888 Nov 21 13:52:38.173503 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 76/156] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:37 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:38.515313 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-15ff8e45-3abf-4f1b-b8ef-63ccf5f528cd tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:38.517436 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-15ff8e45-3abf-4f1b-b8ef-63ccf5f528cd tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:38.527946 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-15ff8e45-3abf-4f1b-b8ef-63ccf5f528cd tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:38.528981 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-15ff8e45-3abf-4f1b-b8ef-63ccf5f528cd tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:38.531680 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-15ff8e45-3abf-4f1b-b8ef-63ccf5f528cd tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:38.532580 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-15ff8e45-3abf-4f1b-b8ef-63ccf5f528cd tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:38.822670 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-15ff8e45-3abf-4f1b-b8ef-63ccf5f528cd tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:38.831255 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-15ff8e45-3abf-4f1b-b8ef-63ccf5f528cd tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.320666 Nov 21 13:52:38.833111 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 81/157] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:38 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:39.057754 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-f7062123-3d47-47c7-bd16-fba6175461f8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:39.058751 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-f7062123-3d47-47c7-bd16-fba6175461f8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:39.061421 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-1e1eca60-728d-4bcd-9765-b08d1f6d817b req-ef857580-8adc-4b5a-984b-773162086f3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa7ec26-0d3e-4d40-87d2-45e63ed435eb", "tag": "e97fd0d3-216a-4615-aa4a-a98857cba123"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:39.063121 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:52:39.063121 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:52:39.071367 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f7062123-3d47-47c7-bd16-fba6175461f8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:39.071916 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f7062123-3d47-47c7-bd16-fba6175461f8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:39.072964 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f7062123-3d47-47c7-bd16-fba6175461f8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:39.074530 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-1e1eca60-728d-4bcd-9765-b08d1f6d817b req-ef857580-8adc-4b5a-984b-773162086f3b service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:39.075298 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-1e1eca60-728d-4bcd-9765-b08d1f6d817b req-ef857580-8adc-4b5a-984b-773162086f3b service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:39.080097 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f7062123-3d47-47c7-bd16-fba6175461f8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:39.103201 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-1e1eca60-728d-4bcd-9765-b08d1f6d817b req-ef857580-8adc-4b5a-984b-773162086f3b service nova] Creating event network-changed:e97fd0d3-216a-4615-aa4a-a98857cba123 for instance 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb on hv-cinder-76845 Nov 21 13:52:39.117011 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-1e1eca60-728d-4bcd-9765-b08d1f6d817b req-ef857580-8adc-4b5a-984b-773162086f3b service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063922 Nov 21 13:52:39.119050 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 82/158] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:52:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:52:39.191724 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-70fbb1dc-15df-4341-bd8f-652b52799ed4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:39.192369 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-70fbb1dc-15df-4341-bd8f-652b52799ed4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:39.199689 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-70fbb1dc-15df-4341-bd8f-652b52799ed4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:39.200351 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-70fbb1dc-15df-4341-bd8f-652b52799ed4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:39.201143 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-70fbb1dc-15df-4341-bd8f-652b52799ed4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:39.201666 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-70fbb1dc-15df-4341-bd8f-652b52799ed4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:39.407169 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-70fbb1dc-15df-4341-bd8f-652b52799ed4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:39.417388 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-70fbb1dc-15df-4341-bd8f-652b52799ed4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:39.419596 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-70fbb1dc-15df-4341-bd8f-652b52799ed4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:39.421309 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-70fbb1dc-15df-4341-bd8f-652b52799ed4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.233692 Nov 21 13:52:39.423022 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 83/159] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:39 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:39.601612 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-caf24a78-099a-4136-84cd-c9c879a298cd req-d069d937-230a-4582-9d9c-387a8f60e124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e92c59-3be1-41c7-8ea1-b1bb65cf39c1", "name": "network-vif-plugged", "status": "completed", "tag": "627d561d-d2ff-449e-a99f-9e5e3fd874ba"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:39.604680 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:52:39.604680 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:52:39.618773 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-caf24a78-099a-4136-84cd-c9c879a298cd req-d069d937-230a-4582-9d9c-387a8f60e124 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:39.620662 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-caf24a78-099a-4136-84cd-c9c879a298cd req-d069d937-230a-4582-9d9c-387a8f60e124 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:39.641596 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-caf24a78-099a-4136-84cd-c9c879a298cd req-d069d937-230a-4582-9d9c-387a8f60e124 service nova] Creating event network-vif-plugged:627d561d-d2ff-449e-a99f-9e5e3fd874ba for instance 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 on hv-cinder-76845 Nov 21 13:52:39.659785 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-caf24a78-099a-4136-84cd-c9c879a298cd req-d069d937-230a-4582-9d9c-387a8f60e124 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061912 Nov 21 13:52:39.668451 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 84/160] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:52:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:52:39.849999 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-10102bc5-1faa-4bc7-b8bd-3282b4461f7e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:39.850801 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-10102bc5-1faa-4bc7-b8bd-3282b4461f7e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:39.857028 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-10102bc5-1faa-4bc7-b8bd-3282b4461f7e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:39.857729 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-10102bc5-1faa-4bc7-b8bd-3282b4461f7e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:39.858724 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-10102bc5-1faa-4bc7-b8bd-3282b4461f7e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:39.859359 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-10102bc5-1faa-4bc7-b8bd-3282b4461f7e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:40.015971 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-10102bc5-1faa-4bc7-b8bd-3282b4461f7e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:40.024070 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-10102bc5-1faa-4bc7-b8bd-3282b4461f7e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.178037 Nov 21 13:52:40.024862 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 85/161] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:39 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:40.440053 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-6e8f865f-327a-4940-8450-2eb646d11fab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:40.440692 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-6e8f865f-327a-4940-8450-2eb646d11fab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:40.446364 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6e8f865f-327a-4940-8450-2eb646d11fab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:40.446810 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6e8f865f-327a-4940-8450-2eb646d11fab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:40.447581 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6e8f865f-327a-4940-8450-2eb646d11fab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:40.448031 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6e8f865f-327a-4940-8450-2eb646d11fab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:40.577024 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-6e8f865f-327a-4940-8450-2eb646d11fab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:40.585545 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-6e8f865f-327a-4940-8450-2eb646d11fab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:40.587031 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-6e8f865f-327a-4940-8450-2eb646d11fab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:40.588149 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-6e8f865f-327a-4940-8450-2eb646d11fab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.151657 Nov 21 13:52:40.588700 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 86/162] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:40 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 13:52:41.039937 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-9c9bfda3-429a-42b6-9d95-a8f1e22d9ece tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:41.040625 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-9c9bfda3-429a-42b6-9d95-a8f1e22d9ece tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:41.046444 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9c9bfda3-429a-42b6-9d95-a8f1e22d9ece tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:41.046974 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9c9bfda3-429a-42b6-9d95-a8f1e22d9ece tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:41.047865 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9c9bfda3-429a-42b6-9d95-a8f1e22d9ece tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:41.048380 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9c9bfda3-429a-42b6-9d95-a8f1e22d9ece tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:41.179294 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-9c9bfda3-429a-42b6-9d95-a8f1e22d9ece tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:41.186528 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-9c9bfda3-429a-42b6-9d95-a8f1e22d9ece tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.150047 Nov 21 13:52:41.187027 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 87/163] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:41 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:41.422940 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-f7062123-3d47-47c7-bd16-fba6175461f8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 14 microversion: 2.1 time: 2.372672 Nov 21 13:52:41.423990 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 77/164] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:52:39 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 14 bytes in 2374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:52:41.608755 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-91573a09-88d2-42c9-b30c-22286716bfa5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:41.609454 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-91573a09-88d2-42c9-b30c-22286716bfa5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:41.615859 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-91573a09-88d2-42c9-b30c-22286716bfa5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:41.616385 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-91573a09-88d2-42c9-b30c-22286716bfa5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:41.617228 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-91573a09-88d2-42c9-b30c-22286716bfa5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:41.617731 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-91573a09-88d2-42c9-b30c-22286716bfa5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:41.754630 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-91573a09-88d2-42c9-b30c-22286716bfa5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:41.762579 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-91573a09-88d2-42c9-b30c-22286716bfa5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:41.764127 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-91573a09-88d2-42c9-b30c-22286716bfa5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:41.765245 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-91573a09-88d2-42c9-b30c-22286716bfa5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.160657 Nov 21 13:52:41.767497 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 88/165] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:41 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:42.203482 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-e5cf7d45-04b2-4f11-92e0-b96f802c2ae2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:42.204144 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-e5cf7d45-04b2-4f11-92e0-b96f802c2ae2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:42.210946 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e5cf7d45-04b2-4f11-92e0-b96f802c2ae2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:42.211391 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e5cf7d45-04b2-4f11-92e0-b96f802c2ae2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:42.212189 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e5cf7d45-04b2-4f11-92e0-b96f802c2ae2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:42.212615 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e5cf7d45-04b2-4f11-92e0-b96f802c2ae2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:42.349710 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-e5cf7d45-04b2-4f11-92e0-b96f802c2ae2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:42.357073 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-e5cf7d45-04b2-4f11-92e0-b96f802c2ae2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.157650 Nov 21 13:52:42.357630 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 78/166] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:42 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:42.434042 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-57f27352-0d74-455f-b70b-2ba3bc2523aa tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:42.434953 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-57f27352-0d74-455f-b70b-2ba3bc2523aa tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:42.440698 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-57f27352-0d74-455f-b70b-2ba3bc2523aa tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:42.441143 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-57f27352-0d74-455f-b70b-2ba3bc2523aa tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:42.441939 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-57f27352-0d74-455f-b70b-2ba3bc2523aa tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:42.442373 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-57f27352-0d74-455f-b70b-2ba3bc2523aa tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:42.784082 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-74ab90b5-0364-4556-9f17-56717f10f1df tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:42.785422 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-74ab90b5-0364-4556-9f17-56717f10f1df tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:42.792082 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-74ab90b5-0364-4556-9f17-56717f10f1df tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:42.792541 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-74ab90b5-0364-4556-9f17-56717f10f1df tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:42.793314 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-74ab90b5-0364-4556-9f17-56717f10f1df tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:42.793740 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-74ab90b5-0364-4556-9f17-56717f10f1df tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:42.934818 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-74ab90b5-0364-4556-9f17-56717f10f1df tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:42.949616 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-74ab90b5-0364-4556-9f17-56717f10f1df tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:42.951151 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-74ab90b5-0364-4556-9f17-56717f10f1df tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:42.952859 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-74ab90b5-0364-4556-9f17-56717f10f1df tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.172697 Nov 21 13:52:42.953952 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 79/167] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:42 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:52:43.374202 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ffbe9de7-e701-487d-b1b5-4316c43a19f3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:43.374807 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ffbe9de7-e701-487d-b1b5-4316c43a19f3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:43.381750 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ffbe9de7-e701-487d-b1b5-4316c43a19f3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:43.382196 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ffbe9de7-e701-487d-b1b5-4316c43a19f3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:43.382957 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ffbe9de7-e701-487d-b1b5-4316c43a19f3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:43.383384 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ffbe9de7-e701-487d-b1b5-4316c43a19f3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:43.507410 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ffbe9de7-e701-487d-b1b5-4316c43a19f3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:43.514496 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ffbe9de7-e701-487d-b1b5-4316c43a19f3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.143917 Nov 21 13:52:43.515056 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 80/168] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:43 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:43.972440 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-12a69844-4367-445c-9eb6-8339200ec01f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:43.973054 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-12a69844-4367-445c-9eb6-8339200ec01f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:43.979153 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-12a69844-4367-445c-9eb6-8339200ec01f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:43.979595 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-12a69844-4367-445c-9eb6-8339200ec01f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:43.980399 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-12a69844-4367-445c-9eb6-8339200ec01f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:43.980833 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-12a69844-4367-445c-9eb6-8339200ec01f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:44.113225 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-12a69844-4367-445c-9eb6-8339200ec01f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:44.120906 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-12a69844-4367-445c-9eb6-8339200ec01f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:44.122400 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-12a69844-4367-445c-9eb6-8339200ec01f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:44.123487 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-12a69844-4367-445c-9eb6-8339200ec01f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.155626 Nov 21 13:52:44.124081 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 81/169] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:43 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 13:52:44.530358 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-15cc39be-e08f-4323-a158-cc66f3c81ca8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:44.530962 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-15cc39be-e08f-4323-a158-cc66f3c81ca8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:44.537456 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-15cc39be-e08f-4323-a158-cc66f3c81ca8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:44.537898 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-15cc39be-e08f-4323-a158-cc66f3c81ca8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:44.538655 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-15cc39be-e08f-4323-a158-cc66f3c81ca8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:44.539085 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-15cc39be-e08f-4323-a158-cc66f3c81ca8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:44.662583 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-15cc39be-e08f-4323-a158-cc66f3c81ca8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:44.669766 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-15cc39be-e08f-4323-a158-cc66f3c81ca8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.143039 Nov 21 13:52:44.670328 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 82/170] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:44 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:45.141122 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a1c86dde-a326-4995-983f-537788897a07 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:45.141737 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a1c86dde-a326-4995-983f-537788897a07 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:45.147909 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a1c86dde-a326-4995-983f-537788897a07 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:45.148363 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a1c86dde-a326-4995-983f-537788897a07 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:45.149132 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a1c86dde-a326-4995-983f-537788897a07 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:45.149564 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a1c86dde-a326-4995-983f-537788897a07 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:45.173908 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-57f27352-0d74-455f-b70b-2ba3bc2523aa tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 14 microversion: 2.1 time: 2.743211 Nov 21 13:52:45.177944 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 89/171] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:52:42 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 14 bytes in 2745 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:52:45.286602 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a1c86dde-a326-4995-983f-537788897a07 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:45.295173 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a1c86dde-a326-4995-983f-537788897a07 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:45.296804 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a1c86dde-a326-4995-983f-537788897a07 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:45.297843 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a1c86dde-a326-4995-983f-537788897a07 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1407 microversion: 2.20 time: 0.160333 Nov 21 13:52:45.298394 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 83/172] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:45 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 13:52:45.686712 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-75696545-0746-422a-bc45-91c662a1a8b1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:45.687238 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-75696545-0746-422a-bc45-91c662a1a8b1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:45.694783 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-75696545-0746-422a-bc45-91c662a1a8b1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:45.695301 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-75696545-0746-422a-bc45-91c662a1a8b1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:45.696113 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-75696545-0746-422a-bc45-91c662a1a8b1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:45.696553 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-75696545-0746-422a-bc45-91c662a1a8b1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:45.830463 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-75696545-0746-422a-bc45-91c662a1a8b1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:45.838488 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-75696545-0746-422a-bc45-91c662a1a8b1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1321 microversion: 2.1 time: 0.156140 Nov 21 13:52:45.839364 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 90/173] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:45 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:46.186173 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-0c6bad84-c446-4704-9ffb-33fad5c1a3fe tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:46.196605 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-0c6bad84-c446-4704-9ffb-33fad5c1a3fe tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:46.205880 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0c6bad84-c446-4704-9ffb-33fad5c1a3fe tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:46.207026 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0c6bad84-c446-4704-9ffb-33fad5c1a3fe tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:46.208019 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0c6bad84-c446-4704-9ffb-33fad5c1a3fe tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:46.209007 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0c6bad84-c446-4704-9ffb-33fad5c1a3fe tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:46.318232 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-3f5d0b8a-ae80-45b8-a7fc-72711aa40e48 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:46.318958 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3f5d0b8a-ae80-45b8-a7fc-72711aa40e48 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:46.322298 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-0c6bad84-c446-4704-9ffb-33fad5c1a3fe tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 14 microversion: 2.1 time: 0.139974 Nov 21 13:52:46.324739 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 84/174] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:52:46 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:52:46.333719 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3f5d0b8a-ae80-45b8-a7fc-72711aa40e48 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:46.334184 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3f5d0b8a-ae80-45b8-a7fc-72711aa40e48 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:46.334970 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3f5d0b8a-ae80-45b8-a7fc-72711aa40e48 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:46.335411 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3f5d0b8a-ae80-45b8-a7fc-72711aa40e48 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:46.542931 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-3f5d0b8a-ae80-45b8-a7fc-72711aa40e48 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:46.551778 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-3f5d0b8a-ae80-45b8-a7fc-72711aa40e48 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:46.557854 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-3f5d0b8a-ae80-45b8-a7fc-72711aa40e48 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:46.559404 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-3f5d0b8a-ae80-45b8-a7fc-72711aa40e48 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1600 microversion: 2.20 time: 0.245961 Nov 21 13:52:46.560993 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 91/175] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:52:46 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1600 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 13:52:46.581388 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-3323bd2d-ef73-4d20-bb46-a8bbb9be1ec2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:46.582295 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-3323bd2d-ef73-4d20-bb46-a8bbb9be1ec2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:46.595966 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3323bd2d-ef73-4d20-bb46-a8bbb9be1ec2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:46.596444 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3323bd2d-ef73-4d20-bb46-a8bbb9be1ec2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:46.597425 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3323bd2d-ef73-4d20-bb46-a8bbb9be1ec2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:46.597868 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3323bd2d-ef73-4d20-bb46-a8bbb9be1ec2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:46.690914 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-3323bd2d-ef73-4d20-bb46-a8bbb9be1ec2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.114333 Nov 21 13:52:46.691791 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 85/176] 10.222.0.11 () {60 vars in 1315 bytes} [Sun Nov 21 13:52:46 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:52:46.855735 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-83786fd9-b8fa-414e-b91a-b36efebea8c2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:46.856382 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-83786fd9-b8fa-414e-b91a-b36efebea8c2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:46.864889 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-83786fd9-b8fa-414e-b91a-b36efebea8c2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:46.865488 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-83786fd9-b8fa-414e-b91a-b36efebea8c2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:46.866580 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-83786fd9-b8fa-414e-b91a-b36efebea8c2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:46.867285 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-83786fd9-b8fa-414e-b91a-b36efebea8c2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:47.312882 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-83786fd9-b8fa-414e-b91a-b36efebea8c2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:47.326035 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-83786fd9-b8fa-414e-b91a-b36efebea8c2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1514 microversion: 2.1 time: 0.473788 Nov 21 13:52:47.327022 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 92/177] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:46 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1514 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:47.339683 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-798d0595-c346-44c5-8690-43b13008460e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:47.339683 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-798d0595-c346-44c5-8690-43b13008460e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:47.350807 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-42d50da3-c0ba-4020-b1db-b08760a6d8e5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:47.351921 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-42d50da3-c0ba-4020-b1db-b08760a6d8e5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:47.352130 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-798d0595-c346-44c5-8690-43b13008460e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:47.352646 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-798d0595-c346-44c5-8690-43b13008460e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:47.353766 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-798d0595-c346-44c5-8690-43b13008460e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:47.354352 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-798d0595-c346-44c5-8690-43b13008460e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:47.360502 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-42d50da3-c0ba-4020-b1db-b08760a6d8e5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:47.361154 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-42d50da3-c0ba-4020-b1db-b08760a6d8e5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:47.362459 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-42d50da3-c0ba-4020-b1db-b08760a6d8e5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:47.363010 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-42d50da3-c0ba-4020-b1db-b08760a6d8e5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:47.410397 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.objects.instance [None req-42d50da3-c0ba-4020-b1db-b08760a6d8e5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lazy-loading 'flavor' on Instance uuid e6f04799-b287-41b6-9756-b259d5eeddeb {{(pid=122564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:52:47.548349 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-42d50da3-c0ba-4020-b1db-b08760a6d8e5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "POST /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb/action" status: 200 len: 32 microversion: 2.1 time: 0.204952 Nov 21 13:52:47.550071 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 93/178] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:52:47 2021] POST /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb/action => generated 32 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:52:47.561288 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b79da8e3-df7d-4252-904b-932916bee27a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:47.561997 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b79da8e3-df7d-4252-904b-932916bee27a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:47.571550 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b79da8e3-df7d-4252-904b-932916bee27a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:47.572054 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b79da8e3-df7d-4252-904b-932916bee27a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:47.573586 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b79da8e3-df7d-4252-904b-932916bee27a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:47.574037 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b79da8e3-df7d-4252-904b-932916bee27a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:47.977966 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-b79da8e3-df7d-4252-904b-932916bee27a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:47.986545 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-b79da8e3-df7d-4252-904b-932916bee27a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.431280 Nov 21 13:52:47.996281 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 94/179] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:47 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:48.415697 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-cc0ee48b-b314-4fed-bae0-7b677a92c44b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:48.416769 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-cc0ee48b-b314-4fed-bae0-7b677a92c44b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:48.425280 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cc0ee48b-b314-4fed-bae0-7b677a92c44b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:48.425934 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cc0ee48b-b314-4fed-bae0-7b677a92c44b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:48.427187 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cc0ee48b-b314-4fed-bae0-7b677a92c44b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:48.427768 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cc0ee48b-b314-4fed-bae0-7b677a92c44b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:49.959396 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-798d0595-c346-44c5-8690-43b13008460e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 14 microversion: 2.1 time: 2.627899 Nov 21 13:52:49.962322 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-cc0ee48b-b314-4fed-bae0-7b677a92c44b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 14 microversion: 2.20 time: 1.550135 Nov 21 13:52:49.963755 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 95/180] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:52:48 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 14 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:49.967622 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 86/181] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:52:47 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 14 bytes in 2637 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:52:49.968988 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-a682a85a-23fb-44cf-b80c-fe75855a2c44 req-f18a7c89-f263-4af8-bdbb-6461be3d8e79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e92c59-3be1-41c7-8ea1-b1bb65cf39c1", "tag": "627d561d-d2ff-449e-a99f-9e5e3fd874ba"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:49.970485 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:52:49.970485 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:52:49.973623 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-d9216956-9cfc-4456-82c4-92d1f97c744a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:49.975282 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-d9216956-9cfc-4456-82c4-92d1f97c744a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:49.984632 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d9216956-9cfc-4456-82c4-92d1f97c744a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:49.985320 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d9216956-9cfc-4456-82c4-92d1f97c744a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:49.986294 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d9216956-9cfc-4456-82c4-92d1f97c744a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:49.986878 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d9216956-9cfc-4456-82c4-92d1f97c744a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:49.989436 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-a682a85a-23fb-44cf-b80c-fe75855a2c44 req-f18a7c89-f263-4af8-bdbb-6461be3d8e79 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:49.989877 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-a682a85a-23fb-44cf-b80c-fe75855a2c44 req-f18a7c89-f263-4af8-bdbb-6461be3d8e79 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:50.029046 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-a682a85a-23fb-44cf-b80c-fe75855a2c44 req-f18a7c89-f263-4af8-bdbb-6461be3d8e79 service nova] Creating event network-changed:627d561d-d2ff-449e-a99f-9e5e3fd874ba for instance 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 on hv-cinder-76845 Nov 21 13:52:50.034319 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-a682a85a-23fb-44cf-b80c-fe75855a2c44 req-f18a7c89-f263-4af8-bdbb-6461be3d8e79 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068819 Nov 21 13:52:50.038967 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 96/182] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:52:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:52:50.352465 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-d9216956-9cfc-4456-82c4-92d1f97c744a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:50.364701 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-d9216956-9cfc-4456-82c4-92d1f97c744a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.395317 Nov 21 13:52:50.365640 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 87/183] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:49 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:50.717517 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-06e7c9b9-5896-4935-9ee1-c7adcefecc25 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:50.718256 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-06e7c9b9-5896-4935-9ee1-c7adcefecc25 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:50.726294 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-06e7c9b9-5896-4935-9ee1-c7adcefecc25 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:50.726772 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-06e7c9b9-5896-4935-9ee1-c7adcefecc25 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:50.727599 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-06e7c9b9-5896-4935-9ee1-c7adcefecc25 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:50.728215 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-06e7c9b9-5896-4935-9ee1-c7adcefecc25 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:50.759751 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-06e7c9b9-5896-4935-9ee1-c7adcefecc25 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Going to try to terminate instance {{(pid=122564) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 21 13:52:50.908682 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-06e7c9b9-5896-4935-9ee1-c7adcefecc25 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "DELETE /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 204 len: 0 microversion: 2.1 time: 0.199310 Nov 21 13:52:50.909868 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 97/184] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 13:52:50 2021] DELETE /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 13:52:50.917876 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-dba7884f-2869-4f43-90c1-8aefe04e6194 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:50.918389 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-dba7884f-2869-4f43-90c1-8aefe04e6194 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:50.930636 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dba7884f-2869-4f43-90c1-8aefe04e6194 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:50.931091 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dba7884f-2869-4f43-90c1-8aefe04e6194 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:50.931929 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dba7884f-2869-4f43-90c1-8aefe04e6194 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:50.932534 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dba7884f-2869-4f43-90c1-8aefe04e6194 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:50.977499 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-8aab9014-4f54-4d00-8e41-f752aae52663 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:50.980905 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-8aab9014-4f54-4d00-8e41-f752aae52663 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:50.990705 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8aab9014-4f54-4d00-8e41-f752aae52663 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:50.991147 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8aab9014-4f54-4d00-8e41-f752aae52663 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:50.991961 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8aab9014-4f54-4d00-8e41-f752aae52663 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:50.992557 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8aab9014-4f54-4d00-8e41-f752aae52663 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:51.080527 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-8aab9014-4f54-4d00-8e41-f752aae52663 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 14 microversion: 2.1 time: 0.108341 Nov 21 13:52:51.081916 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 98/185] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:52:50 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 21 13:52:51.090463 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-666deb2c-25b8-4037-a0c2-563c30b29ab1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:51.091663 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-666deb2c-25b8-4037-a0c2-563c30b29ab1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:51.101470 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-666deb2c-25b8-4037-a0c2-563c30b29ab1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:51.102900 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-666deb2c-25b8-4037-a0c2-563c30b29ab1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:51.104126 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-666deb2c-25b8-4037-a0c2-563c30b29ab1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:51.105455 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-666deb2c-25b8-4037-a0c2-563c30b29ab1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:51.198361 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-666deb2c-25b8-4037-a0c2-563c30b29ab1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 14 microversion: 2.20 time: 0.114394 Nov 21 13:52:51.201853 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 99/186] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:52:51 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:51.283624 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-dba7884f-2869-4f43-90c1-8aefe04e6194 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:51.295726 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-dba7884f-2869-4f43-90c1-8aefe04e6194 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1553 microversion: 2.1 time: 0.381548 Nov 21 13:52:51.296352 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 88/187] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:50 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1553 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:51.382917 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-7c87c799-b35e-456a-ac78-ab2799a502f5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:51.383635 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-7c87c799-b35e-456a-ac78-ab2799a502f5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:51.390398 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7c87c799-b35e-456a-ac78-ab2799a502f5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:51.390855 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7c87c799-b35e-456a-ac78-ab2799a502f5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:51.391647 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7c87c799-b35e-456a-ac78-ab2799a502f5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:51.392114 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7c87c799-b35e-456a-ac78-ab2799a502f5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:51.535285 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-7c87c799-b35e-456a-ac78-ab2799a502f5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:51.542573 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-7c87c799-b35e-456a-ac78-ab2799a502f5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.163599 Nov 21 13:52:51.543139 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 100/188] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:51 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:52.092109 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-90e2809b-f426-4145-9b3c-df59ca7b7fce tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:52.093139 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-90e2809b-f426-4145-9b3c-df59ca7b7fce tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:52.105797 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-90e2809b-f426-4145-9b3c-df59ca7b7fce tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:52.106309 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-90e2809b-f426-4145-9b3c-df59ca7b7fce tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:52.107207 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-90e2809b-f426-4145-9b3c-df59ca7b7fce tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:52.107712 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-90e2809b-f426-4145-9b3c-df59ca7b7fce tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:52.207841 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-90e2809b-f426-4145-9b3c-df59ca7b7fce tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 14 microversion: 2.1 time: 0.118182 Nov 21 13:52:52.209022 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 89/189] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:52:52 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:52:52.211244 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-927c262f-bf38-4673-88a0-b0199b6d2b02 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:52.212203 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-927c262f-bf38-4673-88a0-b0199b6d2b02 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:52.222365 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-927c262f-bf38-4673-88a0-b0199b6d2b02 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:52.222813 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-927c262f-bf38-4673-88a0-b0199b6d2b02 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:52.223609 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-927c262f-bf38-4673-88a0-b0199b6d2b02 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:52.230996 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-927c262f-bf38-4673-88a0-b0199b6d2b02 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:52.314915 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-d8aed061-f79e-45bd-99ec-2dcc6081aafc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:52.315983 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-d8aed061-f79e-45bd-99ec-2dcc6081aafc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:52.323150 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d8aed061-f79e-45bd-99ec-2dcc6081aafc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:52.323561 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d8aed061-f79e-45bd-99ec-2dcc6081aafc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:52.324564 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d8aed061-f79e-45bd-99ec-2dcc6081aafc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:52.324933 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d8aed061-f79e-45bd-99ec-2dcc6081aafc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:52.329244 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-927c262f-bf38-4673-88a0-b0199b6d2b02 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 14 microversion: 2.20 time: 0.122982 Nov 21 13:52:52.330830 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 101/190] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:52:52 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:52.560602 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ffae09e4-b4ee-4600-92d7-1d1af38d1350 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:52.561303 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ffae09e4-b4ee-4600-92d7-1d1af38d1350 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:52.571667 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ffae09e4-b4ee-4600-92d7-1d1af38d1350 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:52.575106 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ffae09e4-b4ee-4600-92d7-1d1af38d1350 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:52.576352 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ffae09e4-b4ee-4600-92d7-1d1af38d1350 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:52.577881 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ffae09e4-b4ee-4600-92d7-1d1af38d1350 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:52.728177 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-d8aed061-f79e-45bd-99ec-2dcc6081aafc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:52.764062 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-d8aed061-f79e-45bd-99ec-2dcc6081aafc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1553 microversion: 2.1 time: 0.447315 Nov 21 13:52:52.766083 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 90/191] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:52 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1553 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:52.858799 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-ffae09e4-b4ee-4600-92d7-1d1af38d1350 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:52.868664 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ffae09e4-b4ee-4600-92d7-1d1af38d1350 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.311976 Nov 21 13:52:52.870481 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 102/192] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:52 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:53.218816 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ea948309-90b8-4010-bddc-7e89662f58e1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:53.219759 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ea948309-90b8-4010-bddc-7e89662f58e1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:53.229236 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ea948309-90b8-4010-bddc-7e89662f58e1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:53.229855 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ea948309-90b8-4010-bddc-7e89662f58e1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:53.230671 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ea948309-90b8-4010-bddc-7e89662f58e1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:53.231289 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ea948309-90b8-4010-bddc-7e89662f58e1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:53.319471 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ea948309-90b8-4010-bddc-7e89662f58e1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 6451 microversion: 2.1 time: 0.104315 Nov 21 13:52:53.320144 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 91/193] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:52:53 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 6451 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:53.342983 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-30bf0af6-896c-44a7-91b7-4b794636900a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:53.344105 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-30bf0af6-896c-44a7-91b7-4b794636900a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:53.351462 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-30bf0af6-896c-44a7-91b7-4b794636900a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:53.352061 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-30bf0af6-896c-44a7-91b7-4b794636900a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:53.353038 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-30bf0af6-896c-44a7-91b7-4b794636900a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:53.353647 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-30bf0af6-896c-44a7-91b7-4b794636900a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:53.427910 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-30bf0af6-896c-44a7-91b7-4b794636900a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 14 microversion: 2.20 time: 0.088896 Nov 21 13:52:53.431199 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 103/194] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:52:53 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:53.780977 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-2b5aa333-8a38-4cab-a0c4-b115d4606d26 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:53.781908 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-2b5aa333-8a38-4cab-a0c4-b115d4606d26 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:53.789511 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2b5aa333-8a38-4cab-a0c4-b115d4606d26 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:53.789960 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2b5aa333-8a38-4cab-a0c4-b115d4606d26 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:53.790743 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2b5aa333-8a38-4cab-a0c4-b115d4606d26 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:53.791172 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2b5aa333-8a38-4cab-a0c4-b115d4606d26 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:53.887236 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2291d560-8cd6-4f0f-af03-6720ff4d9ce8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:53.888248 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-2291d560-8cd6-4f0f-af03-6720ff4d9ce8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:53.905479 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2291d560-8cd6-4f0f-af03-6720ff4d9ce8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:53.905933 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2291d560-8cd6-4f0f-af03-6720ff4d9ce8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:53.906729 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2291d560-8cd6-4f0f-af03-6720ff4d9ce8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:53.907159 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2291d560-8cd6-4f0f-af03-6720ff4d9ce8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:54.009888 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2b5aa333-8a38-4cab-a0c4-b115d4606d26 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:54.017869 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-2b5aa333-8a38-4cab-a0c4-b115d4606d26 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1553 microversion: 2.1 time: 0.240849 Nov 21 13:52:54.019740 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 92/195] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:53 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1553 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:54.054735 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-2291d560-8cd6-4f0f-af03-6720ff4d9ce8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:54.064888 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-2291d560-8cd6-4f0f-af03-6720ff4d9ce8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.182061 Nov 21 13:52:54.066285 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 104/196] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:53 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:54.200155 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-b2957732-ae09-4608-8bb2-aa42ca09f93f req-7ebc2d71-fd6d-4c15-8dc1-427857dbd212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ac629e-e375-4954-82d0-1efb9da7da3b", "name": "network-vif-deleted", "tag": "8653e663-5da8-4b7e-91b0-8c94d45d51ad"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:54.210048 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:52:54.210048 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:52:54.213401 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-b2957732-ae09-4608-8bb2-aa42ca09f93f req-7ebc2d71-fd6d-4c15-8dc1-427857dbd212 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:54.213887 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-b2957732-ae09-4608-8bb2-aa42ca09f93f req-7ebc2d71-fd6d-4c15-8dc1-427857dbd212 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:54.228545 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-b2957732-ae09-4608-8bb2-aa42ca09f93f req-7ebc2d71-fd6d-4c15-8dc1-427857dbd212 service nova] Creating event network-vif-deleted:8653e663-5da8-4b7e-91b0-8c94d45d51ad for instance f7ac629e-e375-4954-82d0-1efb9da7da3b on hv-cinder-76845 Nov 21 13:52:54.233722 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-b2957732-ae09-4608-8bb2-aa42ca09f93f req-7ebc2d71-fd6d-4c15-8dc1-427857dbd212 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039488 Nov 21 13:52:54.234619 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 93/197] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:52:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:52:54.331782 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-fb5952a4-ee05-44d2-93ed-19dbaf4f0eae tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:54.332866 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-fb5952a4-ee05-44d2-93ed-19dbaf4f0eae tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:54.342952 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fb5952a4-ee05-44d2-93ed-19dbaf4f0eae tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:54.343442 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fb5952a4-ee05-44d2-93ed-19dbaf4f0eae tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:54.344250 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fb5952a4-ee05-44d2-93ed-19dbaf4f0eae tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:54.344702 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fb5952a4-ee05-44d2-93ed-19dbaf4f0eae tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:54.427932 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-fb5952a4-ee05-44d2-93ed-19dbaf4f0eae tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 11371 microversion: 2.1 time: 0.100336 Nov 21 13:52:54.429382 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 105/198] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:52:54 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 11371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:52:54.439822 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-00858895-ce92-42a5-acdd-a10adb77a2a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:54.442060 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-00858895-ce92-42a5-acdd-a10adb77a2a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:54.452420 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-00858895-ce92-42a5-acdd-a10adb77a2a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:54.453448 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-00858895-ce92-42a5-acdd-a10adb77a2a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:54.455167 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-00858895-ce92-42a5-acdd-a10adb77a2a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:54.456138 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-00858895-ce92-42a5-acdd-a10adb77a2a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:54.573257 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-00858895-ce92-42a5-acdd-a10adb77a2a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 14 microversion: 2.20 time: 0.137318 Nov 21 13:52:54.575394 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 94/199] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:52:54 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:55.036776 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-6c7cf9ee-96a4-4017-98f0-9d699385648e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:55.042563 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-6c7cf9ee-96a4-4017-98f0-9d699385648e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:55.052436 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6c7cf9ee-96a4-4017-98f0-9d699385648e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:55.052856 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6c7cf9ee-96a4-4017-98f0-9d699385648e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:55.053849 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6c7cf9ee-96a4-4017-98f0-9d699385648e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:55.054476 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6c7cf9ee-96a4-4017-98f0-9d699385648e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:55.094252 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6c7cf9ee-96a4-4017-98f0-9d699385648e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:55.094921 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-45de2312-5fd9-4d9b-b35f-095cfb23536f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:55.095198 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6c7cf9ee-96a4-4017-98f0-9d699385648e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:55.095911 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.objects.instance [None req-6c7cf9ee-96a4-4017-98f0-9d699385648e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lazy-loading 'fault' on Instance uuid f7ac629e-e375-4954-82d0-1efb9da7da3b {{(pid=122564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:52:55.096890 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-45de2312-5fd9-4d9b-b35f-095cfb23536f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:55.113911 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-45de2312-5fd9-4d9b-b35f-095cfb23536f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:55.114751 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-45de2312-5fd9-4d9b-b35f-095cfb23536f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:55.115774 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-45de2312-5fd9-4d9b-b35f-095cfb23536f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:55.116320 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-45de2312-5fd9-4d9b-b35f-095cfb23536f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:55.148852 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-6c7cf9ee-96a4-4017-98f0-9d699385648e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dded159cfd4b48bacae751b36f0ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9580a66e32944e649fafe038a1d4cc4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:55.157320 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-6c7cf9ee-96a4-4017-98f0-9d699385648e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 200 len: 1350 microversion: 2.1 time: 0.125557 Nov 21 13:52:55.158057 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 106/200] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:55 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 1350 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:55.350971 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-45de2312-5fd9-4d9b-b35f-095cfb23536f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:55.361190 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-45de2312-5fd9-4d9b-b35f-095cfb23536f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.278927 Nov 21 13:52:55.362836 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 95/201] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:55 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:55.439512 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-6846c56a-4e9c-403a-9d5b-0520091e99fc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:55.440653 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-6846c56a-4e9c-403a-9d5b-0520091e99fc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:55.447723 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6846c56a-4e9c-403a-9d5b-0520091e99fc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:55.448232 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6846c56a-4e9c-403a-9d5b-0520091e99fc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:55.449023 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6846c56a-4e9c-403a-9d5b-0520091e99fc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:55.449465 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6846c56a-4e9c-403a-9d5b-0520091e99fc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:55.541807 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-6846c56a-4e9c-403a-9d5b-0520091e99fc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 15064 microversion: 2.1 time: 0.105983 Nov 21 13:52:55.546178 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 107/202] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:52:55 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 15064 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:52:55.585623 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c13d4859-84af-4d0c-aae6-412c37e6f750 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:55.586705 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-c13d4859-84af-4d0c-aae6-412c37e6f750 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:55.594968 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c13d4859-84af-4d0c-aae6-412c37e6f750 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:55.595437 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c13d4859-84af-4d0c-aae6-412c37e6f750 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:55.597030 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c13d4859-84af-4d0c-aae6-412c37e6f750 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:55.597709 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c13d4859-84af-4d0c-aae6-412c37e6f750 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:55.668909 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c13d4859-84af-4d0c-aae6-412c37e6f750 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 14 microversion: 2.20 time: 0.086467 Nov 21 13:52:55.670097 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 96/203] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:52:55 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:56.177966 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b8fe82a9-2348-45ae-a364-883863f977dc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:56.178651 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b8fe82a9-2348-45ae-a364-883863f977dc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:56.188462 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b8fe82a9-2348-45ae-a364-883863f977dc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:56.188784 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b8fe82a9-2348-45ae-a364-883863f977dc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:56.189546 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b8fe82a9-2348-45ae-a364-883863f977dc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:56.190863 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b8fe82a9-2348-45ae-a364-883863f977dc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:56.214888 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.wsgi [None req-b8fe82a9-2348-45ae-a364-883863f977dc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] HTTP exception thrown: Instance f7ac629e-e375-4954-82d0-1efb9da7da3b could not be found. Nov 21 13:52:56.215639 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b8fe82a9-2348-45ae-a364-883863f977dc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Returning 404 to user: Instance f7ac629e-e375-4954-82d0-1efb9da7da3b could not be found. {{(pid=122564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:52:56.216680 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-b8fe82a9-2348-45ae-a364-883863f977dc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 404 len: 111 microversion: 2.1 time: 0.043302 Nov 21 13:52:56.217727 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 108/204] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:56 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:52:56.338150 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-adfe6405-3220-43d2-9880-8110d88f1797 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:56.339156 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-adfe6405-3220-43d2-9880-8110d88f1797 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:56.347225 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-adfe6405-3220-43d2-9880-8110d88f1797 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:56.347680 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-adfe6405-3220-43d2-9880-8110d88f1797 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:56.348513 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-adfe6405-3220-43d2-9880-8110d88f1797 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:56.348950 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-adfe6405-3220-43d2-9880-8110d88f1797 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:56.379211 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-bad1091a-6e3d-4374-b23b-6d36a303b9f4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:56.379955 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-bad1091a-6e3d-4374-b23b-6d36a303b9f4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:56.393558 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bad1091a-6e3d-4374-b23b-6d36a303b9f4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:56.394810 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bad1091a-6e3d-4374-b23b-6d36a303b9f4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:56.396712 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bad1091a-6e3d-4374-b23b-6d36a303b9f4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:56.399305 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bad1091a-6e3d-4374-b23b-6d36a303b9f4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:56.404981 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-adfe6405-3220-43d2-9880-8110d88f1797 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] HTTP exception thrown: Instance f7ac629e-e375-4954-82d0-1efb9da7da3b could not be found. Nov 21 13:52:56.407895 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-adfe6405-3220-43d2-9880-8110d88f1797 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Returning 404 to user: Instance f7ac629e-e375-4954-82d0-1efb9da7da3b could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:52:56.408755 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-adfe6405-3220-43d2-9880-8110d88f1797 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.074732 Nov 21 13:52:56.411892 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 97/205] 10.222.0.11 () {58 vars in 1301 bytes} [Sun Nov 21 13:52:56 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b/os-volume_attachments => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:52:56.562210 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-81abefae-0585-4c98-9650-68761ae08eff tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:56.563854 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-81abefae-0585-4c98-9650-68761ae08eff tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:56.571633 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-81abefae-0585-4c98-9650-68761ae08eff tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:56.572270 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-81abefae-0585-4c98-9650-68761ae08eff tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:56.573313 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-81abefae-0585-4c98-9650-68761ae08eff tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:56.574043 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-81abefae-0585-4c98-9650-68761ae08eff tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:56.652692 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-bad1091a-6e3d-4374-b23b-6d36a303b9f4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:56.660507 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-bad1091a-6e3d-4374-b23b-6d36a303b9f4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.285666 Nov 21 13:52:56.661082 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 109/206] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:56 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:56.688797 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-81abefae-0585-4c98-9650-68761ae08eff tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 18155 microversion: 2.1 time: 0.136918 Nov 21 13:52:56.689554 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 98/207] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:52:56 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 18155 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:52:56.694847 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-bf92c2db-9f8c-4fcb-97fe-d2e07508fde3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:56.696487 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-bf92c2db-9f8c-4fcb-97fe-d2e07508fde3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:56.703905 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bf92c2db-9f8c-4fcb-97fe-d2e07508fde3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:56.704640 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bf92c2db-9f8c-4fcb-97fe-d2e07508fde3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:56.706136 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bf92c2db-9f8c-4fcb-97fe-d2e07508fde3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:56.706894 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bf92c2db-9f8c-4fcb-97fe-d2e07508fde3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:56.777423 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-bf92c2db-9f8c-4fcb-97fe-d2e07508fde3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 14 microversion: 2.20 time: 0.093647 Nov 21 13:52:56.780624 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 110/208] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:52:56 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:57.678261 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a08be99e-4fb6-4926-8438-2fbb7da1f445 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:57.678967 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a08be99e-4fb6-4926-8438-2fbb7da1f445 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:57.688457 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a08be99e-4fb6-4926-8438-2fbb7da1f445 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:57.688457 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a08be99e-4fb6-4926-8438-2fbb7da1f445 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:57.688457 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a08be99e-4fb6-4926-8438-2fbb7da1f445 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:57.688457 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a08be99e-4fb6-4926-8438-2fbb7da1f445 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:57.701315 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-d7a5755d-b49a-4520-83e3-e90f37294a94 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:57.702321 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-d7a5755d-b49a-4520-83e3-e90f37294a94 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:57.711960 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d7a5755d-b49a-4520-83e3-e90f37294a94 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:57.712428 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d7a5755d-b49a-4520-83e3-e90f37294a94 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:57.713231 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d7a5755d-b49a-4520-83e3-e90f37294a94 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:57.713670 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d7a5755d-b49a-4520-83e3-e90f37294a94 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:57.811718 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-d7a5755d-b49a-4520-83e3-e90f37294a94 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 18961 microversion: 2.1 time: 0.113329 Nov 21 13:52:57.813493 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 111/209] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:52:57 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 18961 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 13:52:57.822475 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-e69f632f-c71d-410f-9681-eee42a96cb93 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:57.823402 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-e69f632f-c71d-410f-9681-eee42a96cb93 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:57.832551 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e69f632f-c71d-410f-9681-eee42a96cb93 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:57.833497 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e69f632f-c71d-410f-9681-eee42a96cb93 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:57.834543 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e69f632f-c71d-410f-9681-eee42a96cb93 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:57.835828 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e69f632f-c71d-410f-9681-eee42a96cb93 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:57.847865 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a08be99e-4fb6-4926-8438-2fbb7da1f445 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:57.854022 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.wsgi [None req-e69f632f-c71d-410f-9681-eee42a96cb93 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] HTTP exception thrown: Instance f7ac629e-e375-4954-82d0-1efb9da7da3b could not be found. Nov 21 13:52:57.854627 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-e69f632f-c71d-410f-9681-eee42a96cb93 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Returning 404 to user: Instance f7ac629e-e375-4954-82d0-1efb9da7da3b could not be found. {{(pid=122564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:52:57.855693 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-e69f632f-c71d-410f-9681-eee42a96cb93 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "DELETE /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 404 len: 111 microversion: 2.1 time: 0.037249 Nov 21 13:52:57.856378 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 112/210] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 13:52:57 2021] DELETE /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:52:57.857546 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a08be99e-4fb6-4926-8438-2fbb7da1f445 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.183390 Nov 21 13:52:57.858049 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 99/211] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:57 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:57.861863 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-c428b358-1984-4859-b4b0-b3fbf426c4e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:57.863046 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-c428b358-1984-4859-b4b0-b3fbf426c4e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:57.864444 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-e5c646bf-beeb-49fd-a990-4d93f1fe131b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:57.865174 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-e5c646bf-beeb-49fd-a990-4d93f1fe131b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] [instance: f7ac629e-e375-4954-82d0-1efb9da7da3b] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:57.870990 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c428b358-1984-4859-b4b0-b3fbf426c4e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:57.871338 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e5c646bf-beeb-49fd-a990-4d93f1fe131b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:57.871788 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e5c646bf-beeb-49fd-a990-4d93f1fe131b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:57.872134 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c428b358-1984-4859-b4b0-b3fbf426c4e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:57.872877 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e5c646bf-beeb-49fd-a990-4d93f1fe131b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:57.873313 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e5c646bf-beeb-49fd-a990-4d93f1fe131b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:57.873439 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c428b358-1984-4859-b4b0-b3fbf426c4e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:57.874152 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c428b358-1984-4859-b4b0-b3fbf426c4e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:57.888443 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-e5c646bf-beeb-49fd-a990-4d93f1fe131b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] HTTP exception thrown: Instance f7ac629e-e375-4954-82d0-1efb9da7da3b could not be found. Nov 21 13:52:57.889535 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-e5c646bf-beeb-49fd-a990-4d93f1fe131b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Returning 404 to user: Instance f7ac629e-e375-4954-82d0-1efb9da7da3b could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:52:57.890371 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-e5c646bf-beeb-49fd-a990-4d93f1fe131b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b" status: 404 len: 111 microversion: 2.1 time: 0.029668 Nov 21 13:52:57.890924 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 100/212] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:57 2021] GET /compute/v2.1/servers/f7ac629e-e375-4954-82d0-1efb9da7da3b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:52:57.957011 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-c428b358-1984-4859-b4b0-b3fbf426c4e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 14 microversion: 2.20 time: 0.098822 Nov 21 13:52:57.957651 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 113/213] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:52:57 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:58.824032 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-1f22646a-e340-4bfa-8467-c6f62d70860e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:58.824937 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-1f22646a-e340-4bfa-8467-c6f62d70860e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:58.832848 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1f22646a-e340-4bfa-8467-c6f62d70860e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:58.833479 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1f22646a-e340-4bfa-8467-c6f62d70860e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:58.834492 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1f22646a-e340-4bfa-8467-c6f62d70860e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:58.835070 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1f22646a-e340-4bfa-8467-c6f62d70860e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:58.878408 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-18fcc76e-df14-4e3c-befb-2141538eb0b8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:52:58.880094 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-18fcc76e-df14-4e3c-befb-2141538eb0b8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:58.888719 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-18fcc76e-df14-4e3c-befb-2141538eb0b8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:58.889472 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-18fcc76e-df14-4e3c-befb-2141538eb0b8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:58.890492 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-18fcc76e-df14-4e3c-befb-2141538eb0b8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:58.891209 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-18fcc76e-df14-4e3c-befb-2141538eb0b8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:58.913410 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-1f22646a-e340-4bfa-8467-c6f62d70860e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 21159 microversion: 2.1 time: 0.092408 Nov 21 13:52:58.918439 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 101/214] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:52:58 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 21159 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:52:58.968149 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-30b21983-97bf-4c8c-abf9-271bc964f9a2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:58.969154 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-30b21983-97bf-4c8c-abf9-271bc964f9a2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:58.975823 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-30b21983-97bf-4c8c-abf9-271bc964f9a2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:58.976573 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-30b21983-97bf-4c8c-abf9-271bc964f9a2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:58.977582 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-30b21983-97bf-4c8c-abf9-271bc964f9a2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:58.978212 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-30b21983-97bf-4c8c-abf9-271bc964f9a2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:59.071641 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-30b21983-97bf-4c8c-abf9-271bc964f9a2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 14 microversion: 2.20 time: 0.103578 Nov 21 13:52:59.075204 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 102/215] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:52:58 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:52:59.107919 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-18fcc76e-df14-4e3c-befb-2141538eb0b8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:52:59.118417 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-18fcc76e-df14-4e3c-befb-2141538eb0b8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.245045 Nov 21 13:52:59.119006 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 114/216] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:52:58 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:52:59.926693 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-d97b4dbb-4331-4650-b12d-40e69c390cfd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:52:59.927609 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-d97b4dbb-4331-4650-b12d-40e69c390cfd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:52:59.934502 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d97b4dbb-4331-4650-b12d-40e69c390cfd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:59.935206 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d97b4dbb-4331-4650-b12d-40e69c390cfd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:52:59.936239 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d97b4dbb-4331-4650-b12d-40e69c390cfd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:52:59.936871 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d97b4dbb-4331-4650-b12d-40e69c390cfd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:00.022890 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-d97b4dbb-4331-4650-b12d-40e69c390cfd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 22852 microversion: 2.1 time: 0.099952 Nov 21 13:53:00.024431 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 103/217] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:52:59 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 22852 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:00.082955 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-8913f664-cc37-4bf8-bf62-cccc8cb30cfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:00.083968 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-8913f664-cc37-4bf8-bf62-cccc8cb30cfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:00.090499 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8913f664-cc37-4bf8-bf62-cccc8cb30cfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:00.090954 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8913f664-cc37-4bf8-bf62-cccc8cb30cfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:00.091777 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8913f664-cc37-4bf8-bf62-cccc8cb30cfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:00.092252 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8913f664-cc37-4bf8-bf62-cccc8cb30cfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:00.136970 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-e41e4a91-5e97-4f49-8054-5645cf01bd94 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:00.137672 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-e41e4a91-5e97-4f49-8054-5645cf01bd94 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:00.145785 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e41e4a91-5e97-4f49-8054-5645cf01bd94 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:00.146246 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e41e4a91-5e97-4f49-8054-5645cf01bd94 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:00.147209 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e41e4a91-5e97-4f49-8054-5645cf01bd94 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:00.147652 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e41e4a91-5e97-4f49-8054-5645cf01bd94 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:00.169019 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-8913f664-cc37-4bf8-bf62-cccc8cb30cfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 14 microversion: 2.20 time: 0.088477 Nov 21 13:53:00.171208 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 115/218] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:00 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:00.370276 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-e41e4a91-5e97-4f49-8054-5645cf01bd94 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:00.378081 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-e41e4a91-5e97-4f49-8054-5645cf01bd94 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.245179 Nov 21 13:53:00.378658 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 104/219] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:00 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:53:01.038456 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-08b77e50-4499-4492-b02b-b46f786c92d1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:01.040171 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-08b77e50-4499-4492-b02b-b46f786c92d1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:01.048512 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-08b77e50-4499-4492-b02b-b46f786c92d1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:01.049253 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-08b77e50-4499-4492-b02b-b46f786c92d1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:01.050346 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-08b77e50-4499-4492-b02b-b46f786c92d1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:01.051155 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-08b77e50-4499-4492-b02b-b46f786c92d1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:01.133794 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-08b77e50-4499-4492-b02b-b46f786c92d1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 23922 microversion: 2.1 time: 0.101260 Nov 21 13:53:01.141311 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 116/220] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:01 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 23922 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:01.193616 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c54b1693-3cb3-41d9-b67e-5a8524b8f722 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:01.197157 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-c54b1693-3cb3-41d9-b67e-5a8524b8f722 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:01.205139 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c54b1693-3cb3-41d9-b67e-5a8524b8f722 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:01.210729 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c54b1693-3cb3-41d9-b67e-5a8524b8f722 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:01.211763 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c54b1693-3cb3-41d9-b67e-5a8524b8f722 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:01.212203 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c54b1693-3cb3-41d9-b67e-5a8524b8f722 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:01.289312 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c54b1693-3cb3-41d9-b67e-5a8524b8f722 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 14 microversion: 2.20 time: 0.100236 Nov 21 13:53:01.289312 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 105/221] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:01 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:01.396393 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ffa8c95c-100e-41fb-9fff-d125d6746d6c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:01.397363 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ffa8c95c-100e-41fb-9fff-d125d6746d6c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:01.404278 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ffa8c95c-100e-41fb-9fff-d125d6746d6c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:01.404876 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ffa8c95c-100e-41fb-9fff-d125d6746d6c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:01.405786 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ffa8c95c-100e-41fb-9fff-d125d6746d6c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:01.406264 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ffa8c95c-100e-41fb-9fff-d125d6746d6c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:01.553297 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-ffa8c95c-100e-41fb-9fff-d125d6746d6c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:01.560554 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ffa8c95c-100e-41fb-9fff-d125d6746d6c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.169128 Nov 21 13:53:01.561122 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 117/222] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:01 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:02.149659 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-731fee43-1b2e-4ae8-9e6e-aa6f2de5a702 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:02.151252 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-731fee43-1b2e-4ae8-9e6e-aa6f2de5a702 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:02.158480 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-731fee43-1b2e-4ae8-9e6e-aa6f2de5a702 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:02.159098 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-731fee43-1b2e-4ae8-9e6e-aa6f2de5a702 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:02.160091 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-731fee43-1b2e-4ae8-9e6e-aa6f2de5a702 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:02.160730 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-731fee43-1b2e-4ae8-9e6e-aa6f2de5a702 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:02.265330 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-731fee43-1b2e-4ae8-9e6e-aa6f2de5a702 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 25262 microversion: 2.1 time: 0.119344 Nov 21 13:53:02.271217 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 106/223] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:02 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 25262 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:02.301643 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-90e54867-ddc4-47ad-9080-df434cb200f1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:02.308560 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-90e54867-ddc4-47ad-9080-df434cb200f1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:02.316090 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-90e54867-ddc4-47ad-9080-df434cb200f1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:02.316695 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-90e54867-ddc4-47ad-9080-df434cb200f1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:02.318290 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-90e54867-ddc4-47ad-9080-df434cb200f1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:02.318916 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-90e54867-ddc4-47ad-9080-df434cb200f1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:02.408749 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-90e54867-ddc4-47ad-9080-df434cb200f1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 1198 microversion: 2.20 time: 0.113584 Nov 21 13:53:02.412000 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 118/224] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:02 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 1198 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:53:02.579182 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-fec403da-ede8-4a67-9b1c-0c36d8bd400e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:02.580149 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-fec403da-ede8-4a67-9b1c-0c36d8bd400e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:02.587955 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fec403da-ede8-4a67-9b1c-0c36d8bd400e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:02.588483 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fec403da-ede8-4a67-9b1c-0c36d8bd400e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:02.589415 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fec403da-ede8-4a67-9b1c-0c36d8bd400e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:02.589926 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fec403da-ede8-4a67-9b1c-0c36d8bd400e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:02.753483 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-fec403da-ede8-4a67-9b1c-0c36d8bd400e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:02.761176 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-fec403da-ede8-4a67-9b1c-0c36d8bd400e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.186571 Nov 21 13:53:02.761673 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 107/225] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:02 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:03.279212 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-555cebcb-e5e1-49f2-875c-b9053ecef536 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:03.280453 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-555cebcb-e5e1-49f2-875c-b9053ecef536 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:03.294730 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-555cebcb-e5e1-49f2-875c-b9053ecef536 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:03.294730 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-555cebcb-e5e1-49f2-875c-b9053ecef536 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:03.294730 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-555cebcb-e5e1-49f2-875c-b9053ecef536 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:03.294730 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-555cebcb-e5e1-49f2-875c-b9053ecef536 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:03.386192 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-555cebcb-e5e1-49f2-875c-b9053ecef536 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 25949 microversion: 2.1 time: 0.110968 Nov 21 13:53:03.386842 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 119/226] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:03 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 25949 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:03.420191 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-90ea0eb9-97d4-41ec-b155-ff359f03e238 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:03.421367 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-90ea0eb9-97d4-41ec-b155-ff359f03e238 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:03.427273 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-90ea0eb9-97d4-41ec-b155-ff359f03e238 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:03.427634 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-90ea0eb9-97d4-41ec-b155-ff359f03e238 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:03.428446 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-90ea0eb9-97d4-41ec-b155-ff359f03e238 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:03.428884 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-90ea0eb9-97d4-41ec-b155-ff359f03e238 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:03.529913 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-90ea0eb9-97d4-41ec-b155-ff359f03e238 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 8481 microversion: 2.20 time: 0.113918 Nov 21 13:53:03.530544 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 108/227] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:03 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 8481 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:53:03.782952 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-5d4ebf1c-8b06-409b-8de7-76fd7835b2ce tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:03.783848 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-5d4ebf1c-8b06-409b-8de7-76fd7835b2ce tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:03.791195 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5d4ebf1c-8b06-409b-8de7-76fd7835b2ce tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:03.791904 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5d4ebf1c-8b06-409b-8de7-76fd7835b2ce tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:03.792916 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5d4ebf1c-8b06-409b-8de7-76fd7835b2ce tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:03.793542 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5d4ebf1c-8b06-409b-8de7-76fd7835b2ce tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:03.961794 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-5d4ebf1c-8b06-409b-8de7-76fd7835b2ce tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:03.969506 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-5d4ebf1c-8b06-409b-8de7-76fd7835b2ce tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.194854 Nov 21 13:53:03.970063 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 120/228] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:03 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:04.398884 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ed77bfe6-71ed-49bc-a7e7-7874e7d68a28 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:04.400181 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ed77bfe6-71ed-49bc-a7e7-7874e7d68a28 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:04.407581 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ed77bfe6-71ed-49bc-a7e7-7874e7d68a28 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:04.408075 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ed77bfe6-71ed-49bc-a7e7-7874e7d68a28 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:04.408900 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ed77bfe6-71ed-49bc-a7e7-7874e7d68a28 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:04.409339 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ed77bfe6-71ed-49bc-a7e7-7874e7d68a28 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:04.541894 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-605ff1e7-a4f9-4aee-8728-27a7b15206ac tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:04.542814 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-605ff1e7-a4f9-4aee-8728-27a7b15206ac tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:04.548989 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-605ff1e7-a4f9-4aee-8728-27a7b15206ac tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:04.549978 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-605ff1e7-a4f9-4aee-8728-27a7b15206ac tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:04.550765 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-605ff1e7-a4f9-4aee-8728-27a7b15206ac tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:04.551202 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-605ff1e7-a4f9-4aee-8728-27a7b15206ac tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:06.763520 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ed77bfe6-71ed-49bc-a7e7-7874e7d68a28 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 27165 microversion: 2.1 time: 2.368790 Nov 21 13:53:06.767598 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 109/229] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:04 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 27165 bytes in 2371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:06.770142 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-97b62126-470e-4d56-b77e-fbf44a74c342 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:06.771116 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-97b62126-470e-4d56-b77e-fbf44a74c342 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:06.777020 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-605ff1e7-a4f9-4aee-8728-27a7b15206ac tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 17808 microversion: 2.20 time: 2.238694 Nov 21 13:53:06.777804 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 121/230] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:04 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 17808 bytes in 2240 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:53:06.778233 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-97b62126-470e-4d56-b77e-fbf44a74c342 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:06.778754 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-97b62126-470e-4d56-b77e-fbf44a74c342 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:06.779686 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-97b62126-470e-4d56-b77e-fbf44a74c342 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:06.780148 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-97b62126-470e-4d56-b77e-fbf44a74c342 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:06.931081 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-97b62126-470e-4d56-b77e-fbf44a74c342 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:06.939758 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-97b62126-470e-4d56-b77e-fbf44a74c342 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.173491 Nov 21 13:53:06.940393 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 110/231] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:06 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:07.778400 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-91d59ab1-4df1-4f72-9921-409fd933d336 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:07.782995 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-91d59ab1-4df1-4f72-9921-409fd933d336 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:07.796656 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-91d59ab1-4df1-4f72-9921-409fd933d336 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:07.797242 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-91d59ab1-4df1-4f72-9921-409fd933d336 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:07.798201 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-91d59ab1-4df1-4f72-9921-409fd933d336 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:07.798807 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-91d59ab1-4df1-4f72-9921-409fd933d336 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:07.831388 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-26036e6c-fbe0-4156-9973-84d79169b5c1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:07.832449 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-26036e6c-fbe0-4156-9973-84d79169b5c1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:07.841170 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-26036e6c-fbe0-4156-9973-84d79169b5c1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:07.842062 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-26036e6c-fbe0-4156-9973-84d79169b5c1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:07.843003 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-26036e6c-fbe0-4156-9973-84d79169b5c1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:07.843600 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-26036e6c-fbe0-4156-9973-84d79169b5c1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:07.898867 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-91d59ab1-4df1-4f72-9921-409fd933d336 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 27570 microversion: 2.1 time: 0.122102 Nov 21 13:53:07.910050 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 122/232] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:07 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 27570 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:07.940098 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-26036e6c-fbe0-4156-9973-84d79169b5c1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 18013 microversion: 2.20 time: 0.112814 Nov 21 13:53:07.940978 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 111/233] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:07 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 18013 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:53:07.961714 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-229c7b7c-8bae-44fe-9d0f-0de960323429 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:07.963156 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-229c7b7c-8bae-44fe-9d0f-0de960323429 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:07.982680 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-229c7b7c-8bae-44fe-9d0f-0de960323429 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:07.983480 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-229c7b7c-8bae-44fe-9d0f-0de960323429 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:07.984536 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-229c7b7c-8bae-44fe-9d0f-0de960323429 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:07.988028 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-229c7b7c-8bae-44fe-9d0f-0de960323429 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:08.242220 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-229c7b7c-8bae-44fe-9d0f-0de960323429 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:08.252401 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-229c7b7c-8bae-44fe-9d0f-0de960323429 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.298068 Nov 21 13:53:08.253252 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 123/234] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:07 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:08.913377 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-5388dbc8-bf09-4f51-8eb6-7cc6489d8303 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:08.916292 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-5388dbc8-bf09-4f51-8eb6-7cc6489d8303 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:08.926833 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5388dbc8-bf09-4f51-8eb6-7cc6489d8303 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:08.927346 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5388dbc8-bf09-4f51-8eb6-7cc6489d8303 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:08.928430 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5388dbc8-bf09-4f51-8eb6-7cc6489d8303 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:08.929135 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5388dbc8-bf09-4f51-8eb6-7cc6489d8303 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:08.953364 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-0e71b821-1a46-43dc-9e85-65dbfba18cf7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:08.955454 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-0e71b821-1a46-43dc-9e85-65dbfba18cf7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:08.969675 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0e71b821-1a46-43dc-9e85-65dbfba18cf7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:08.970843 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0e71b821-1a46-43dc-9e85-65dbfba18cf7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:08.973947 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0e71b821-1a46-43dc-9e85-65dbfba18cf7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:08.975522 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0e71b821-1a46-43dc-9e85-65dbfba18cf7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:11.000616 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-5388dbc8-bf09-4f51-8eb6-7cc6489d8303 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 27684 microversion: 2.1 time: 2.092487 Nov 21 13:53:11.001369 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 112/235] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:08 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 27684 bytes in 2095 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:11.006798 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-be024f9a-811d-4faa-ade0-6e7017e3293f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:11.007495 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-be024f9a-811d-4faa-ade0-6e7017e3293f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:11.015426 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-be024f9a-811d-4faa-ade0-6e7017e3293f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:11.016159 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-be024f9a-811d-4faa-ade0-6e7017e3293f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:11.016310 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-0e71b821-1a46-43dc-9e85-65dbfba18cf7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 23659 microversion: 2.20 time: 2.067961 Nov 21 13:53:11.017233 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 124/236] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:08 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 23659 bytes in 2070 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:53:11.017912 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-be024f9a-811d-4faa-ade0-6e7017e3293f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:11.018497 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-be024f9a-811d-4faa-ade0-6e7017e3293f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:11.179177 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-be024f9a-811d-4faa-ade0-6e7017e3293f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:11.187567 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-be024f9a-811d-4faa-ade0-6e7017e3293f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.184543 Nov 21 13:53:11.189360 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 113/237] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:11 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:12.013853 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-75348cee-217c-4c56-8ed9-12cb981e9901 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:12.014973 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-75348cee-217c-4c56-8ed9-12cb981e9901 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:12.028481 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-164a2533-bbd5-4608-8299-75ada9b358d8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:12.029395 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-164a2533-bbd5-4608-8299-75ada9b358d8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:12.030533 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-75348cee-217c-4c56-8ed9-12cb981e9901 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:12.031534 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-75348cee-217c-4c56-8ed9-12cb981e9901 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:12.034640 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-75348cee-217c-4c56-8ed9-12cb981e9901 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:12.035342 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-75348cee-217c-4c56-8ed9-12cb981e9901 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:12.043240 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-164a2533-bbd5-4608-8299-75ada9b358d8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:12.043956 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-164a2533-bbd5-4608-8299-75ada9b358d8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:12.044893 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-164a2533-bbd5-4608-8299-75ada9b358d8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:12.045705 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-164a2533-bbd5-4608-8299-75ada9b358d8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:12.140753 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-164a2533-bbd5-4608-8299-75ada9b358d8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 24613 microversion: 2.20 time: 0.116106 Nov 21 13:53:12.142081 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 114/238] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:12 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 24613 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:53:12.167818 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-75348cee-217c-4c56-8ed9-12cb981e9901 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 28163 microversion: 2.1 time: 0.158175 Nov 21 13:53:12.172677 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 125/239] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:12 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 28163 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:12.206291 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-490a17e4-5b5a-472f-be9a-d554778d4c55 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:12.207129 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-490a17e4-5b5a-472f-be9a-d554778d4c55 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:12.219348 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-490a17e4-5b5a-472f-be9a-d554778d4c55 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:12.219829 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-490a17e4-5b5a-472f-be9a-d554778d4c55 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:12.223564 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-490a17e4-5b5a-472f-be9a-d554778d4c55 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:12.224054 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-490a17e4-5b5a-472f-be9a-d554778d4c55 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:12.512988 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-490a17e4-5b5a-472f-be9a-d554778d4c55 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:12.526263 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-490a17e4-5b5a-472f-be9a-d554778d4c55 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.324238 Nov 21 13:53:12.527057 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 115/240] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:12 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:13.154165 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-534bf2ff-6332-412a-b2d0-eef23e26574e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:13.155902 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-534bf2ff-6332-412a-b2d0-eef23e26574e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:13.166469 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-534bf2ff-6332-412a-b2d0-eef23e26574e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:13.166837 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-534bf2ff-6332-412a-b2d0-eef23e26574e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:13.167630 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-534bf2ff-6332-412a-b2d0-eef23e26574e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:13.171890 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-534bf2ff-6332-412a-b2d0-eef23e26574e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:13.179965 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-e09e7b4c-3249-4b21-9302-c0eed036822d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:13.181332 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-e09e7b4c-3249-4b21-9302-c0eed036822d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:13.193731 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e09e7b4c-3249-4b21-9302-c0eed036822d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:13.194393 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e09e7b4c-3249-4b21-9302-c0eed036822d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:13.195407 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e09e7b4c-3249-4b21-9302-c0eed036822d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:13.196067 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e09e7b4c-3249-4b21-9302-c0eed036822d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:15.287207 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-534bf2ff-6332-412a-b2d0-eef23e26574e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 27434 microversion: 2.20 time: 2.137870 Nov 21 13:53:15.287875 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-e09e7b4c-3249-4b21-9302-c0eed036822d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 28163 microversion: 2.1 time: 2.111975 Nov 21 13:53:15.300355 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 116/241] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:13 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 28163 bytes in 2113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 13:53:15.300355 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-fd56a059-860c-4fbc-9d22-a93961d9c385 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:15.300355 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-fd56a059-860c-4fbc-9d22-a93961d9c385 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:15.301984 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fd56a059-860c-4fbc-9d22-a93961d9c385 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:15.302640 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fd56a059-860c-4fbc-9d22-a93961d9c385 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:15.303605 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fd56a059-860c-4fbc-9d22-a93961d9c385 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:15.304226 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fd56a059-860c-4fbc-9d22-a93961d9c385 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:15.328173 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 126/242] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:13 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 27434 bytes in 2180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:53:15.553929 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-fd56a059-860c-4fbc-9d22-a93961d9c385 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:15.566963 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-fd56a059-860c-4fbc-9d22-a93961d9c385 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.276214 Nov 21 13:53:15.578146 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 117/243] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:15 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:16.324569 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-1cb22f6d-a63d-4f25-992c-159a46b41184 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:16.326357 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-1cb22f6d-a63d-4f25-992c-159a46b41184 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:16.336483 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1cb22f6d-a63d-4f25-992c-159a46b41184 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:16.337236 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1cb22f6d-a63d-4f25-992c-159a46b41184 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:16.338323 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1cb22f6d-a63d-4f25-992c-159a46b41184 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:16.339184 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1cb22f6d-a63d-4f25-992c-159a46b41184 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:16.361385 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-d5f4478e-795d-4758-b0f7-1747e45d42fd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:16.371780 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-d5f4478e-795d-4758-b0f7-1747e45d42fd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:16.384554 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d5f4478e-795d-4758-b0f7-1747e45d42fd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:16.390232 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d5f4478e-795d-4758-b0f7-1747e45d42fd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:16.390232 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d5f4478e-795d-4758-b0f7-1747e45d42fd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:16.398328 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d5f4478e-795d-4758-b0f7-1747e45d42fd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:16.531647 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-1cb22f6d-a63d-4f25-992c-159a46b41184 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 27663 microversion: 2.20 time: 0.212067 Nov 21 13:53:16.538286 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 127/244] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:16 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 27663 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:53:16.555663 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-d5f4478e-795d-4758-b0f7-1747e45d42fd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 28163 microversion: 2.1 time: 0.198933 Nov 21 13:53:16.556481 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 118/245] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:16 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 28163 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:16.597500 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-16efd947-eb12-4771-823a-fb2ae7c04f72 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:16.598396 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-16efd947-eb12-4771-823a-fb2ae7c04f72 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:16.615781 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-16efd947-eb12-4771-823a-fb2ae7c04f72 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:16.617928 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-16efd947-eb12-4771-823a-fb2ae7c04f72 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:16.617928 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-16efd947-eb12-4771-823a-fb2ae7c04f72 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:16.618498 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-16efd947-eb12-4771-823a-fb2ae7c04f72 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:16.919536 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-16efd947-eb12-4771-823a-fb2ae7c04f72 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:16.935272 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-16efd947-eb12-4771-823a-fb2ae7c04f72 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.345500 Nov 21 13:53:16.937328 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 128/246] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:16 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:17.544098 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a13bac1d-6864-45a1-a854-627c092adfe8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:17.545132 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a13bac1d-6864-45a1-a854-627c092adfe8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:17.554516 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a13bac1d-6864-45a1-a854-627c092adfe8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:17.555739 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a13bac1d-6864-45a1-a854-627c092adfe8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:17.560143 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a13bac1d-6864-45a1-a854-627c092adfe8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:17.560857 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a13bac1d-6864-45a1-a854-627c092adfe8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:17.583536 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-9a76b8ae-1f0c-4392-92c4-bf0be90cee99 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:17.585123 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-9a76b8ae-1f0c-4392-92c4-bf0be90cee99 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:17.601880 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9a76b8ae-1f0c-4392-92c4-bf0be90cee99 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:17.602634 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9a76b8ae-1f0c-4392-92c4-bf0be90cee99 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:17.604553 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9a76b8ae-1f0c-4392-92c4-bf0be90cee99 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:17.605194 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9a76b8ae-1f0c-4392-92c4-bf0be90cee99 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:17.685064 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a13bac1d-6864-45a1-a854-627c092adfe8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 28087 microversion: 2.20 time: 0.145236 Nov 21 13:53:17.685844 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 119/247] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:17 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 28087 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:53:17.734212 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-9a76b8ae-1f0c-4392-92c4-bf0be90cee99 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 28163 microversion: 2.1 time: 0.168046 Nov 21 13:53:17.741856 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 129/248] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:17 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 28163 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:17.954038 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-8b4faa6a-2c55-448a-8622-4d54bd7330cf tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:17.955915 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-8b4faa6a-2c55-448a-8622-4d54bd7330cf tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:17.964590 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8b4faa6a-2c55-448a-8622-4d54bd7330cf tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:17.965451 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8b4faa6a-2c55-448a-8622-4d54bd7330cf tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:17.966933 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8b4faa6a-2c55-448a-8622-4d54bd7330cf tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:17.968043 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8b4faa6a-2c55-448a-8622-4d54bd7330cf tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:18.159515 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-8b4faa6a-2c55-448a-8622-4d54bd7330cf tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:18.174919 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-8b4faa6a-2c55-448a-8622-4d54bd7330cf tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.225660 Nov 21 13:53:18.181149 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 120/249] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:17 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:18.503002 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-53a81d64-935b-4f34-ad45-1831d43ba2dd tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-763881464", "imageRef": "acdb574e-2ba9-4029-849b-377b4d5722ce", "flavorRef": "452"}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:18.580854 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.network.neutron [None req-53a81d64-935b-4f34-ad45-1831d43ba2dd tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] validate_networks() for None {{(pid=122564) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 21 13:53:18.698690 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-0ba88432-aacf-4a68-85b2-5beea446c920 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:18.699932 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-0ba88432-aacf-4a68-85b2-5beea446c920 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:18.706829 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0ba88432-aacf-4a68-85b2-5beea446c920 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:18.709439 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0ba88432-aacf-4a68-85b2-5beea446c920 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:18.709439 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0ba88432-aacf-4a68-85b2-5beea446c920 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:18.709439 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0ba88432-aacf-4a68-85b2-5beea446c920 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:18.803589 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-0ba88432-aacf-4a68-85b2-5beea446c920 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 28202 microversion: 2.20 time: 0.108964 Nov 21 13:53:18.804272 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 121/250] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:18 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 28202 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:53:18.809746 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-bc4ca653-0ac2-4813-acbe-999e67b19929 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:18.811181 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-bc4ca653-0ac2-4813-acbe-999e67b19929 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:18.818963 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bc4ca653-0ac2-4813-acbe-999e67b19929 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:18.819554 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bc4ca653-0ac2-4813-acbe-999e67b19929 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:18.820439 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bc4ca653-0ac2-4813-acbe-999e67b19929 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:18.821121 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bc4ca653-0ac2-4813-acbe-999e67b19929 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:18.923839 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-bc4ca653-0ac2-4813-acbe-999e67b19929 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 28453 microversion: 2.1 time: 0.117740 Nov 21 13:53:18.926719 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 122/251] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:18 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 28453 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:19.037054 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-53a81d64-935b-4f34-ad45-1831d43ba2dd tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Flavor limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 13:53:19.037608 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-53a81d64-935b-4f34-ad45-1831d43ba2dd tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Image limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 13:53:19.037921 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-53a81d64-935b-4f34-ad45-1831d43ba2dd tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Flavor pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 13:53:19.038327 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-53a81d64-935b-4f34-ad45-1831d43ba2dd tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Image pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 13:53:19.038735 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-53a81d64-935b-4f34-ad45-1831d43ba2dd tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 13:53:19.047851 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-53a81d64-935b-4f34-ad45-1831d43ba2dd tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:19.048594 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-53a81d64-935b-4f34-ad45-1831d43ba2dd tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:19.049790 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-53a81d64-935b-4f34-ad45-1831d43ba2dd tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:19.050445 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-53a81d64-935b-4f34-ad45-1831d43ba2dd tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:19.069803 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-53a81d64-935b-4f34-ad45-1831d43ba2dd tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Getting quotas for project 9fec3a1c72184d41a6e85ec8ece002db. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:53:19.074547 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-53a81d64-935b-4f34-ad45-1831d43ba2dd tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Getting quotas for user 788d44a8ed8b429282e923bcd13cf26f and project 9fec3a1c72184d41a6e85ec8ece002db. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:53:19.088423 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-53a81d64-935b-4f34-ad45-1831d43ba2dd tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Going to run 1 instances... {{(pid=122564) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 13:53:19.092022 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-53a81d64-935b-4f34-ad45-1831d43ba2dd tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] [instance: a010f06f-1270-458b-a306-5e93a074e67a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='acdb574e-2ba9-4029-849b-377b4d5722ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 13:53:19.141877 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-53a81d64-935b-4f34-ad45-1831d43ba2dd tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643795 Nov 21 13:53:19.143500 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 130/252] 10.222.0.11 () {60 vars in 1146 bytes} [Sun Nov 21 13:53:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 13:53:19.154106 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-4ec60add-f487-4248-adf3-e713d3264035 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:19.154797 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-4ec60add-f487-4248-adf3-e713d3264035 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] [instance: a010f06f-1270-458b-a306-5e93a074e67a] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:19.199552 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-1285d768-5404-42eb-8f00-4f48680eaef1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:19.200975 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-1285d768-5404-42eb-8f00-4f48680eaef1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:19.212329 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1285d768-5404-42eb-8f00-4f48680eaef1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:19.214700 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1285d768-5404-42eb-8f00-4f48680eaef1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:19.215445 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1285d768-5404-42eb-8f00-4f48680eaef1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:19.217392 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1285d768-5404-42eb-8f00-4f48680eaef1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:19.272155 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4ec60add-f487-4248-adf3-e713d3264035 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788d44a8ed8b429282e923bcd13cf26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fec3a1c72184d41a6e85ec8ece002db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:19.285265 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-4ec60add-f487-4248-adf3-e713d3264035 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a" status: 200 len: 1214 microversion: 2.1 time: 0.132896 Nov 21 13:53:19.286572 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 123/253] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:19 2021] GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a => generated 1214 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:19.622688 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-1285d768-5404-42eb-8f00-4f48680eaef1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:19.634736 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-1285d768-5404-42eb-8f00-4f48680eaef1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.440399 Nov 21 13:53:19.636883 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 131/254] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:19 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:53:19.817018 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-1738f594-1bb1-4eea-88d6-f625c3d0ba47 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:19.825824 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-1738f594-1bb1-4eea-88d6-f625c3d0ba47 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:19.846293 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1738f594-1bb1-4eea-88d6-f625c3d0ba47 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:19.847993 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1738f594-1bb1-4eea-88d6-f625c3d0ba47 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:19.850790 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1738f594-1bb1-4eea-88d6-f625c3d0ba47 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:19.853423 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1738f594-1bb1-4eea-88d6-f625c3d0ba47 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:19.934640 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ffe7d74f-93b8-413e-a45c-48662230de31 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:19.935704 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ffe7d74f-93b8-413e-a45c-48662230de31 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:19.948701 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-1738f594-1bb1-4eea-88d6-f625c3d0ba47 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 28202 microversion: 2.20 time: 0.134775 Nov 21 13:53:19.950406 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 124/255] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:19 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 28202 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:53:19.954380 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ffe7d74f-93b8-413e-a45c-48662230de31 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:19.956115 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ffe7d74f-93b8-413e-a45c-48662230de31 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:19.957082 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ffe7d74f-93b8-413e-a45c-48662230de31 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:19.957613 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ffe7d74f-93b8-413e-a45c-48662230de31 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:20.087230 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ffe7d74f-93b8-413e-a45c-48662230de31 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 28470 microversion: 2.1 time: 0.156066 Nov 21 13:53:20.088606 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 132/256] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:19 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 28470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 13:53:20.305666 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-d3c8eccf-8eea-49e4-b823-7c74f433b119 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:20.306925 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-d3c8eccf-8eea-49e4-b823-7c74f433b119 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] [instance: a010f06f-1270-458b-a306-5e93a074e67a] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:20.324667 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d3c8eccf-8eea-49e4-b823-7c74f433b119 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:20.326716 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d3c8eccf-8eea-49e4-b823-7c74f433b119 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:20.327829 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d3c8eccf-8eea-49e4-b823-7c74f433b119 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:20.340294 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d3c8eccf-8eea-49e4-b823-7c74f433b119 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:20.448950 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-d3c8eccf-8eea-49e4-b823-7c74f433b119 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788d44a8ed8b429282e923bcd13cf26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fec3a1c72184d41a6e85ec8ece002db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:20.457100 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-d3c8eccf-8eea-49e4-b823-7c74f433b119 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a" status: 200 len: 1266 microversion: 2.1 time: 0.156861 Nov 21 13:53:20.459635 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 125/257] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:20 2021] GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:20.656295 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-0bd7a0f6-6ebf-48ee-bed7-46ed829e1e5f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:20.657131 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-0bd7a0f6-6ebf-48ee-bed7-46ed829e1e5f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:20.667425 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0bd7a0f6-6ebf-48ee-bed7-46ed829e1e5f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:20.668299 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0bd7a0f6-6ebf-48ee-bed7-46ed829e1e5f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:20.671025 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0bd7a0f6-6ebf-48ee-bed7-46ed829e1e5f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:20.672047 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0bd7a0f6-6ebf-48ee-bed7-46ed829e1e5f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:20.905589 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-0bd7a0f6-6ebf-48ee-bed7-46ed829e1e5f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:20.918824 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-0bd7a0f6-6ebf-48ee-bed7-46ed829e1e5f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.264634 Nov 21 13:53:20.919121 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 133/258] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:20 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:20.965707 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c626dc92-535d-4d79-91e5-c52f844967c0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:20.967282 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-c626dc92-535d-4d79-91e5-c52f844967c0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:20.975587 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c626dc92-535d-4d79-91e5-c52f844967c0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:20.977074 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c626dc92-535d-4d79-91e5-c52f844967c0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:20.978761 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c626dc92-535d-4d79-91e5-c52f844967c0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:20.979390 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c626dc92-535d-4d79-91e5-c52f844967c0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:21.100875 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-676ffc2c-9680-49a2-9619-932bdbd17f4b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:21.102600 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-676ffc2c-9680-49a2-9619-932bdbd17f4b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:21.110556 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-676ffc2c-9680-49a2-9619-932bdbd17f4b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:21.111395 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-676ffc2c-9680-49a2-9619-932bdbd17f4b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:21.111599 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c626dc92-535d-4d79-91e5-c52f844967c0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 28202 microversion: 2.20 time: 0.152055 Nov 21 13:53:21.115524 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 126/259] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:20 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 28202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:53:21.116418 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-676ffc2c-9680-49a2-9619-932bdbd17f4b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:21.117524 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-676ffc2c-9680-49a2-9619-932bdbd17f4b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:21.213938 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-676ffc2c-9680-49a2-9619-932bdbd17f4b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 28618 microversion: 2.1 time: 0.118762 Nov 21 13:53:21.218955 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 134/260] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:21 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 28618 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 13:53:21.478633 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-beae2396-a950-43ce-b493-6f54f11d61ef tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:21.479933 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-beae2396-a950-43ce-b493-6f54f11d61ef tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] [instance: a010f06f-1270-458b-a306-5e93a074e67a] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:21.504962 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-beae2396-a950-43ce-b493-6f54f11d61ef tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:21.507307 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-beae2396-a950-43ce-b493-6f54f11d61ef tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:21.509634 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-beae2396-a950-43ce-b493-6f54f11d61ef tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:21.510093 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-beae2396-a950-43ce-b493-6f54f11d61ef tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:21.844678 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-beae2396-a950-43ce-b493-6f54f11d61ef tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788d44a8ed8b429282e923bcd13cf26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fec3a1c72184d41a6e85ec8ece002db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:21.859552 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-beae2396-a950-43ce-b493-6f54f11d61ef tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a" status: 200 len: 1272 microversion: 2.1 time: 0.383449 Nov 21 13:53:21.860078 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 127/261] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:21 2021] GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a => generated 1272 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:21.935446 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b1cdeb82-bb6c-49e2-b092-a86353da8a92 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:21.936245 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b1cdeb82-bb6c-49e2-b092-a86353da8a92 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:21.947661 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b1cdeb82-bb6c-49e2-b092-a86353da8a92 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:21.948149 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b1cdeb82-bb6c-49e2-b092-a86353da8a92 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:21.948950 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b1cdeb82-bb6c-49e2-b092-a86353da8a92 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:21.949393 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b1cdeb82-bb6c-49e2-b092-a86353da8a92 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:22.122701 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-12dde8aa-5da9-44ff-97ee-c3145dff0467 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:22.123628 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-12dde8aa-5da9-44ff-97ee-c3145dff0467 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:22.134562 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-12dde8aa-5da9-44ff-97ee-c3145dff0467 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:22.135044 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-12dde8aa-5da9-44ff-97ee-c3145dff0467 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:22.135847 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-12dde8aa-5da9-44ff-97ee-c3145dff0467 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:22.136286 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-12dde8aa-5da9-44ff-97ee-c3145dff0467 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:22.218137 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-b1cdeb82-bb6c-49e2-b092-a86353da8a92 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:22.241352 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-b1cdeb82-bb6c-49e2-b092-a86353da8a92 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.310084 Nov 21 13:53:22.242133 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 135/262] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:21 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:22.254911 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-3c459c93-28ea-4dab-af27-9e2da665c593 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:22.268269 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3c459c93-28ea-4dab-af27-9e2da665c593 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:22.284733 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3c459c93-28ea-4dab-af27-9e2da665c593 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:22.285874 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3c459c93-28ea-4dab-af27-9e2da665c593 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:22.287570 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3c459c93-28ea-4dab-af27-9e2da665c593 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:22.288259 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3c459c93-28ea-4dab-af27-9e2da665c593 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:22.301321 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-12dde8aa-5da9-44ff-97ee-c3145dff0467 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 28492 microversion: 2.20 time: 0.182118 Nov 21 13:53:22.303724 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 128/263] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:22 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 28492 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:53:22.376040 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-3c459c93-28ea-4dab-af27-9e2da665c593 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 28618 microversion: 2.1 time: 0.128874 Nov 21 13:53:22.376747 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 136/264] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:22 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 28618 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:22.879709 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-73415799-1d83-48a0-88f5-669f2a951a02 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:22.880472 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-73415799-1d83-48a0-88f5-669f2a951a02 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] [instance: a010f06f-1270-458b-a306-5e93a074e67a] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:22.894714 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-73415799-1d83-48a0-88f5-669f2a951a02 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:22.895219 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-73415799-1d83-48a0-88f5-669f2a951a02 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:22.900315 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-73415799-1d83-48a0-88f5-669f2a951a02 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:22.901568 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-73415799-1d83-48a0-88f5-669f2a951a02 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:23.095438 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-73415799-1d83-48a0-88f5-669f2a951a02 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788d44a8ed8b429282e923bcd13cf26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fec3a1c72184d41a6e85ec8ece002db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:23.107849 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-73415799-1d83-48a0-88f5-669f2a951a02 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a" status: 200 len: 1272 microversion: 2.1 time: 0.234183 Nov 21 13:53:23.111593 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 129/265] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:22 2021] GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a => generated 1272 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:53:23.272356 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b4a01c13-9489-41cb-a3d7-dac5de9a0502 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:23.272356 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b4a01c13-9489-41cb-a3d7-dac5de9a0502 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:23.301385 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b4a01c13-9489-41cb-a3d7-dac5de9a0502 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:23.302130 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b4a01c13-9489-41cb-a3d7-dac5de9a0502 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:23.303966 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b4a01c13-9489-41cb-a3d7-dac5de9a0502 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:23.304638 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b4a01c13-9489-41cb-a3d7-dac5de9a0502 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:23.326078 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-41334a2e-0178-4969-a504-9fe86ad20092 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:23.328580 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-41334a2e-0178-4969-a504-9fe86ad20092 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:23.346974 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-41334a2e-0178-4969-a504-9fe86ad20092 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:23.349999 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-41334a2e-0178-4969-a504-9fe86ad20092 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:23.351598 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-41334a2e-0178-4969-a504-9fe86ad20092 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:23.353577 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-41334a2e-0178-4969-a504-9fe86ad20092 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:23.485286 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-41334a2e-0178-4969-a504-9fe86ad20092 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 28659 microversion: 2.20 time: 0.170768 Nov 21 13:53:23.486108 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 130/266] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:23 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 28659 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:53:23.505506 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ad512d0d-afff-4fe9-804f-284251374132 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:23.506863 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ad512d0d-afff-4fe9-804f-284251374132 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:23.529058 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ad512d0d-afff-4fe9-804f-284251374132 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:23.529584 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ad512d0d-afff-4fe9-804f-284251374132 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:23.530422 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ad512d0d-afff-4fe9-804f-284251374132 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:23.530854 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ad512d0d-afff-4fe9-804f-284251374132 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:23.747560 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-b4a01c13-9489-41cb-a3d7-dac5de9a0502 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:23.764380 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ad512d0d-afff-4fe9-804f-284251374132 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 28618 microversion: 2.1 time: 0.272719 Nov 21 13:53:23.765118 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-b4a01c13-9489-41cb-a3d7-dac5de9a0502 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1520 microversion: 2.1 time: 0.507705 Nov 21 13:53:23.765489 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 131/267] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:23 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 28618 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:23.766544 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 137/268] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:23 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1520 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:24.129766 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-fc4d2f0a-3ec2-4ddc-8692-496701b14c5a tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:24.130766 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-fc4d2f0a-3ec2-4ddc-8692-496701b14c5a tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] [instance: a010f06f-1270-458b-a306-5e93a074e67a] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:24.146977 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fc4d2f0a-3ec2-4ddc-8692-496701b14c5a tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:24.149458 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fc4d2f0a-3ec2-4ddc-8692-496701b14c5a tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:24.151564 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fc4d2f0a-3ec2-4ddc-8692-496701b14c5a tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:24.153699 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fc4d2f0a-3ec2-4ddc-8692-496701b14c5a tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:24.499433 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-83750aad-287c-4819-b19b-b0e8860c6b5e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:24.500534 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-83750aad-287c-4819-b19b-b0e8860c6b5e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:24.510102 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-83750aad-287c-4819-b19b-b0e8860c6b5e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:24.510555 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-83750aad-287c-4819-b19b-b0e8860c6b5e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:24.514879 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-83750aad-287c-4819-b19b-b0e8860c6b5e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:24.515400 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-83750aad-287c-4819-b19b-b0e8860c6b5e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:24.622566 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-83750aad-287c-4819-b19b-b0e8860c6b5e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 28659 microversion: 2.20 time: 0.127882 Nov 21 13:53:24.623921 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 138/269] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:24 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 28659 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:53:24.726001 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-fc4d2f0a-3ec2-4ddc-8692-496701b14c5a tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788d44a8ed8b429282e923bcd13cf26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fec3a1c72184d41a6e85ec8ece002db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:24.733653 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-fc4d2f0a-3ec2-4ddc-8692-496701b14c5a tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a" status: 200 len: 1314 microversion: 2.1 time: 0.608922 Nov 21 13:53:24.739340 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 132/270] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:24 2021] GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a => generated 1314 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:24.776676 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-05fed7aa-4aed-4fa6-900d-03732368c1e9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:24.783316 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-2924723b-a14c-4f22-b394-82030b304ce5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:24.784082 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-2924723b-a14c-4f22-b394-82030b304ce5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:24.788661 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-05fed7aa-4aed-4fa6-900d-03732368c1e9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:24.804465 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2924723b-a14c-4f22-b394-82030b304ce5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:24.804985 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2924723b-a14c-4f22-b394-82030b304ce5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:24.807090 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2924723b-a14c-4f22-b394-82030b304ce5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:24.807617 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2924723b-a14c-4f22-b394-82030b304ce5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:24.808104 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-05fed7aa-4aed-4fa6-900d-03732368c1e9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:24.808820 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-05fed7aa-4aed-4fa6-900d-03732368c1e9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:24.815862 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-05fed7aa-4aed-4fa6-900d-03732368c1e9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:24.816627 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-05fed7aa-4aed-4fa6-900d-03732368c1e9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:24.935817 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-05fed7aa-4aed-4fa6-900d-03732368c1e9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 28618 microversion: 2.1 time: 0.162909 Nov 21 13:53:24.941657 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 139/271] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:24 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 28618 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:25.209760 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2924723b-a14c-4f22-b394-82030b304ce5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:25.217026 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-2924723b-a14c-4f22-b394-82030b304ce5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1500 microversion: 2.1 time: 0.437511 Nov 21 13:53:25.232435 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 133/272] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:24 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1500 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:25.236921 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-1168aac2-de20-4963-ab64-a0c6cda97a21 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:25.238160 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-1168aac2-de20-4963-ab64-a0c6cda97a21 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:25.256255 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1168aac2-de20-4963-ab64-a0c6cda97a21 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:25.257157 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1168aac2-de20-4963-ab64-a0c6cda97a21 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:25.259909 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1168aac2-de20-4963-ab64-a0c6cda97a21 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:25.260678 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1168aac2-de20-4963-ab64-a0c6cda97a21 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:25.643358 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-976a7fdc-ad43-4bd6-9a18-6cd028cf9687 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:25.647721 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-976a7fdc-ad43-4bd6-9a18-6cd028cf9687 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:25.657690 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-976a7fdc-ad43-4bd6-9a18-6cd028cf9687 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:25.659658 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-976a7fdc-ad43-4bd6-9a18-6cd028cf9687 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:25.660947 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-976a7fdc-ad43-4bd6-9a18-6cd028cf9687 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:25.661848 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-976a7fdc-ad43-4bd6-9a18-6cd028cf9687 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:25.717932 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-1168aac2-de20-4963-ab64-a0c6cda97a21 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:25.725646 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-1168aac2-de20-4963-ab64-a0c6cda97a21 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1515 microversion: 2.1 time: 0.494373 Nov 21 13:53:25.726247 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 140/273] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:25 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1515 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:25.750033 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-976a7fdc-ad43-4bd6-9a18-6cd028cf9687 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 28659 microversion: 2.20 time: 0.117297 Nov 21 13:53:25.752821 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 134/274] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:25 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 28659 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:53:25.756075 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-8013c45e-3d6f-4814-9f49-adcac31c2588 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:25.756697 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-8013c45e-3d6f-4814-9f49-adcac31c2588 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] [instance: a010f06f-1270-458b-a306-5e93a074e67a] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:25.765646 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8013c45e-3d6f-4814-9f49-adcac31c2588 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:25.766397 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8013c45e-3d6f-4814-9f49-adcac31c2588 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:25.767480 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8013c45e-3d6f-4814-9f49-adcac31c2588 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:25.768199 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8013c45e-3d6f-4814-9f49-adcac31c2588 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:25.950813 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-dfdd6aa3-0524-4ef3-a0ac-8526678907de tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:25.953327 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-dfdd6aa3-0524-4ef3-a0ac-8526678907de tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:25.963699 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dfdd6aa3-0524-4ef3-a0ac-8526678907de tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:25.964473 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dfdd6aa3-0524-4ef3-a0ac-8526678907de tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:25.965479 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dfdd6aa3-0524-4ef3-a0ac-8526678907de tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:25.966122 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dfdd6aa3-0524-4ef3-a0ac-8526678907de tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:26.050813 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-8013c45e-3d6f-4814-9f49-adcac31c2588 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788d44a8ed8b429282e923bcd13cf26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fec3a1c72184d41a6e85ec8ece002db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:26.062390 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-8013c45e-3d6f-4814-9f49-adcac31c2588 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a" status: 200 len: 1314 microversion: 2.1 time: 0.310143 Nov 21 13:53:26.063692 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 141/275] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:25 2021] GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:26.079361 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-dfdd6aa3-0524-4ef3-a0ac-8526678907de tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 28739 microversion: 2.1 time: 0.133557 Nov 21 13:53:26.084113 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 135/276] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:25 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 28739 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 13:53:26.147677 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-cd5d740a-f3dd-4d77-8707-1c945d0889f2 req-8b45e89e-0333-458d-b311-f1864c970606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a010f06f-1270-458b-a306-5e93a074e67a", "tag": "cb431e0d-b009-419d-9f2a-352a0a7111d7"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:26.149409 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:53:26.149409 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:53:26.159577 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-cd5d740a-f3dd-4d77-8707-1c945d0889f2 req-8b45e89e-0333-458d-b311-f1864c970606 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:26.160286 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-cd5d740a-f3dd-4d77-8707-1c945d0889f2 req-8b45e89e-0333-458d-b311-f1864c970606 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:26.175047 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-cd5d740a-f3dd-4d77-8707-1c945d0889f2 req-8b45e89e-0333-458d-b311-f1864c970606 service nova] Creating event network-changed:cb431e0d-b009-419d-9f2a-352a0a7111d7 for instance a010f06f-1270-458b-a306-5e93a074e67a on hv-cinder-76845 Nov 21 13:53:26.183945 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-cd5d740a-f3dd-4d77-8707-1c945d0889f2 req-8b45e89e-0333-458d-b311-f1864c970606 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043731 Nov 21 13:53:26.185226 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 142/277] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:53:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:53:26.679264 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c7de9803-2adc-4b79-910c-2ba473cae2db tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Action: 'create', calling method: .version_select at 0x7fd5137fe3a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1260128638"}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:26.700120 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-c7de9803-2adc-4b79-910c-2ba473cae2db tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Getting quotas for project 3f91d0ec3fb5421aa1fb95a0cb0d040d. Resources: {'key_pairs'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:53:26.707704 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-c7de9803-2adc-4b79-910c-2ba473cae2db tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Getting quotas for user 11c7290106424ae8bc4ddf72844fc3a8 and project 3f91d0ec3fb5421aa1fb95a0cb0d040d. Resources: {'key_pairs'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:53:26.766228 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-8b391711-4fc2-477c-bc11-91a3ea432b09 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:26.768497 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-8b391711-4fc2-477c-bc11-91a3ea432b09 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:26.776556 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8b391711-4fc2-477c-bc11-91a3ea432b09 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:26.782537 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8b391711-4fc2-477c-bc11-91a3ea432b09 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:26.784014 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8b391711-4fc2-477c-bc11-91a3ea432b09 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:26.786655 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8b391711-4fc2-477c-bc11-91a3ea432b09 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:26.895555 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-8b391711-4fc2-477c-bc11-91a3ea432b09 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 28659 microversion: 2.20 time: 0.131728 Nov 21 13:53:26.895555 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 143/278] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:26 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 28659 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:53:26.919131 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-c7de9803-2adc-4b79-910c-2ba473cae2db tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Getting quotas for project 3f91d0ec3fb5421aa1fb95a0cb0d040d. Resources: {'key_pairs'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:53:26.923983 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-c7de9803-2adc-4b79-910c-2ba473cae2db tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Getting quotas for user 11c7290106424ae8bc4ddf72844fc3a8 and project 3f91d0ec3fb5421aa1fb95a0cb0d040d. Resources: {'key_pairs'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:53:26.952115 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c7de9803-2adc-4b79-910c-2ba473cae2db tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.548998 Nov 21 13:53:26.953492 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 136/279] 10.222.0.11 () {60 vars in 1157 bytes} [Sun Nov 21 13:53:26 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:27.080501 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-82b92937-9114-4b1c-87fe-1722aa82cf77 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:27.081509 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-82b92937-9114-4b1c-87fe-1722aa82cf77 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] [instance: a010f06f-1270-458b-a306-5e93a074e67a] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:27.088899 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-82b92937-9114-4b1c-87fe-1722aa82cf77 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:27.090070 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-82b92937-9114-4b1c-87fe-1722aa82cf77 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:27.091213 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-44909406-e7e5-4a44-a033-6d66dab86781 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:27.091660 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-82b92937-9114-4b1c-87fe-1722aa82cf77 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:27.092138 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-82b92937-9114-4b1c-87fe-1722aa82cf77 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:27.093002 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-44909406-e7e5-4a44-a033-6d66dab86781 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:27.105123 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-44909406-e7e5-4a44-a033-6d66dab86781 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:27.105645 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-44909406-e7e5-4a44-a033-6d66dab86781 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:27.106389 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-44909406-e7e5-4a44-a033-6d66dab86781 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:27.108951 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-44909406-e7e5-4a44-a033-6d66dab86781 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:27.268452 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-44909406-e7e5-4a44-a033-6d66dab86781 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 29748 microversion: 2.1 time: 0.180567 Nov 21 13:53:27.273716 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 137/280] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:27 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 29748 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 13:53:27.279704 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-d811a6a1-b744-473d-b585-3e7865a98cac tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:27.280982 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-d811a6a1-b744-473d-b585-3e7865a98cac tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:27.289534 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d811a6a1-b744-473d-b585-3e7865a98cac tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:27.290217 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d811a6a1-b744-473d-b585-3e7865a98cac tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:27.291173 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d811a6a1-b744-473d-b585-3e7865a98cac tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:27.292006 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d811a6a1-b744-473d-b585-3e7865a98cac tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:27.321822 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.objects.instance [None req-d811a6a1-b744-473d-b585-3e7865a98cac tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lazy-loading 'flavor' on Instance uuid 2d1c9d3d-f088-4d2f-b2bc-e26543509aae {{(pid=122565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:53:27.322333 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-82b92937-9114-4b1c-87fe-1722aa82cf77 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788d44a8ed8b429282e923bcd13cf26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fec3a1c72184d41a6e85ec8ece002db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:27.331120 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-82b92937-9114-4b1c-87fe-1722aa82cf77 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a" status: 200 len: 1314 microversion: 2.1 time: 0.254499 Nov 21 13:53:27.340660 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 144/281] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:27 2021] GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:27.514998 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-d811a6a1-b744-473d-b585-3e7865a98cac tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "POST /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae/action" status: 200 len: 32 microversion: 2.1 time: 0.239531 Nov 21 13:53:27.517081 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 138/282] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:27 2021] POST /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae/action => generated 32 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:53:27.526003 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-c18bdc3f-ee78-496a-86c4-a5806dcfd6b3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:27.526955 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-c18bdc3f-ee78-496a-86c4-a5806dcfd6b3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:27.534755 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c18bdc3f-ee78-496a-86c4-a5806dcfd6b3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:27.535535 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c18bdc3f-ee78-496a-86c4-a5806dcfd6b3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:27.537903 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c18bdc3f-ee78-496a-86c4-a5806dcfd6b3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:27.538621 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c18bdc3f-ee78-496a-86c4-a5806dcfd6b3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:27.795444 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-c18bdc3f-ee78-496a-86c4-a5806dcfd6b3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:27.808513 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-c18bdc3f-ee78-496a-86c4-a5806dcfd6b3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.286275 Nov 21 13:53:27.818305 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 145/283] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:27 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:27.907046 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-e8de3d27-2cf6-4a90-83ed-54e1cc5a54a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:27.915465 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-e8de3d27-2cf6-4a90-83ed-54e1cc5a54a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:27.938284 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e8de3d27-2cf6-4a90-83ed-54e1cc5a54a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:27.938952 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e8de3d27-2cf6-4a90-83ed-54e1cc5a54a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:27.940839 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e8de3d27-2cf6-4a90-83ed-54e1cc5a54a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:27.942043 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e8de3d27-2cf6-4a90-83ed-54e1cc5a54a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:28.074400 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-e8de3d27-2cf6-4a90-83ed-54e1cc5a54a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 28659 microversion: 2.20 time: 0.171689 Nov 21 13:53:28.075055 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 139/284] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:27 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 28659 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:53:28.281466 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-f2af4ed4-98a5-4a0f-b102-d3f9321a924c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:28.282928 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-f2af4ed4-98a5-4a0f-b102-d3f9321a924c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:28.290446 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f2af4ed4-98a5-4a0f-b102-d3f9321a924c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:28.293023 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f2af4ed4-98a5-4a0f-b102-d3f9321a924c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:28.294107 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f2af4ed4-98a5-4a0f-b102-d3f9321a924c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:28.294763 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f2af4ed4-98a5-4a0f-b102-d3f9321a924c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:28.363673 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-b4324411-e31e-4d8b-bf99-6a47623ca204 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:28.368197 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-b4324411-e31e-4d8b-bf99-6a47623ca204 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] [instance: a010f06f-1270-458b-a306-5e93a074e67a] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:28.382534 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b4324411-e31e-4d8b-bf99-6a47623ca204 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:28.384363 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b4324411-e31e-4d8b-bf99-6a47623ca204 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:28.386403 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b4324411-e31e-4d8b-bf99-6a47623ca204 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:28.388025 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b4324411-e31e-4d8b-bf99-6a47623ca204 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:28.416611 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-f2af4ed4-98a5-4a0f-b102-d3f9321a924c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 30606 microversion: 2.1 time: 0.134545 Nov 21 13:53:28.417449 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 146/285] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:28 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 30606 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:28.624991 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-b4324411-e31e-4d8b-bf99-6a47623ca204 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788d44a8ed8b429282e923bcd13cf26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fec3a1c72184d41a6e85ec8ece002db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:28.634969 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-b4324411-e31e-4d8b-bf99-6a47623ca204 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a" status: 200 len: 1314 microversion: 2.1 time: 0.282452 Nov 21 13:53:28.635877 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 140/286] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:28 2021] GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:28.826152 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-db42c740-0af2-482c-9a6c-5123d58177f4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:28.828240 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-db42c740-0af2-482c-9a6c-5123d58177f4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:28.837207 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-db42c740-0af2-482c-9a6c-5123d58177f4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:28.838114 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-db42c740-0af2-482c-9a6c-5123d58177f4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:28.839200 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-db42c740-0af2-482c-9a6c-5123d58177f4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:28.840081 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-db42c740-0af2-482c-9a6c-5123d58177f4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:29.035158 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-db42c740-0af2-482c-9a6c-5123d58177f4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:29.043609 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-db42c740-0af2-482c-9a6c-5123d58177f4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.221498 Nov 21 13:53:29.044736 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 147/287] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:28 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:29.088613 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a79e284c-bfce-420e-b2ed-ac96b6ac149f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:29.091066 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a79e284c-bfce-420e-b2ed-ac96b6ac149f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:29.104104 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a79e284c-bfce-420e-b2ed-ac96b6ac149f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:29.104565 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a79e284c-bfce-420e-b2ed-ac96b6ac149f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:29.105363 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a79e284c-bfce-420e-b2ed-ac96b6ac149f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:29.105796 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a79e284c-bfce-420e-b2ed-ac96b6ac149f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:29.204787 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a79e284c-bfce-420e-b2ed-ac96b6ac149f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 28659 microversion: 2.20 time: 0.121880 Nov 21 13:53:29.205686 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 141/288] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:29 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 28659 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:53:29.429697 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-fa560e72-7181-4b0e-86e1-2bd91cddc526 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:29.430757 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-fa560e72-7181-4b0e-86e1-2bd91cddc526 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:29.438368 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fa560e72-7181-4b0e-86e1-2bd91cddc526 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:29.440218 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fa560e72-7181-4b0e-86e1-2bd91cddc526 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:29.441112 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fa560e72-7181-4b0e-86e1-2bd91cddc526 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:29.441711 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fa560e72-7181-4b0e-86e1-2bd91cddc526 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:29.519454 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-fa560e72-7181-4b0e-86e1-2bd91cddc526 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 31381 microversion: 2.1 time: 0.093459 Nov 21 13:53:29.524939 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 148/289] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:29 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 31381 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:29.656296 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-4c2302ac-3538-4110-a2cf-a4ba128d0d97 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:29.657012 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-4c2302ac-3538-4110-a2cf-a4ba128d0d97 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] [instance: a010f06f-1270-458b-a306-5e93a074e67a] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:29.680758 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4c2302ac-3538-4110-a2cf-a4ba128d0d97 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:29.681340 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4c2302ac-3538-4110-a2cf-a4ba128d0d97 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:29.682330 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4c2302ac-3538-4110-a2cf-a4ba128d0d97 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:29.686372 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4c2302ac-3538-4110-a2cf-a4ba128d0d97 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:29.872300 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4c2302ac-3538-4110-a2cf-a4ba128d0d97 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788d44a8ed8b429282e923bcd13cf26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fec3a1c72184d41a6e85ec8ece002db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:29.881186 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-4c2302ac-3538-4110-a2cf-a4ba128d0d97 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a" status: 200 len: 1314 microversion: 2.1 time: 0.231786 Nov 21 13:53:29.881960 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 142/290] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:29 2021] GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:53:30.063784 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-f15c9c5e-5995-487a-a832-6f484ba2a657 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:30.064561 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-f15c9c5e-5995-487a-a832-6f484ba2a657 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:30.072471 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f15c9c5e-5995-487a-a832-6f484ba2a657 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:30.072928 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f15c9c5e-5995-487a-a832-6f484ba2a657 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:30.073733 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f15c9c5e-5995-487a-a832-6f484ba2a657 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:30.074249 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f15c9c5e-5995-487a-a832-6f484ba2a657 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:30.217138 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-5d2f5581-2120-44b8-bec2-f95cb132373e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:30.219037 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-5d2f5581-2120-44b8-bec2-f95cb132373e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:30.231216 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-f15c9c5e-5995-487a-a832-6f484ba2a657 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:30.233622 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5d2f5581-2120-44b8-bec2-f95cb132373e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:30.234253 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5d2f5581-2120-44b8-bec2-f95cb132373e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:30.235973 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5d2f5581-2120-44b8-bec2-f95cb132373e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:30.236561 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5d2f5581-2120-44b8-bec2-f95cb132373e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:30.239917 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-f15c9c5e-5995-487a-a832-6f484ba2a657 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.181313 Nov 21 13:53:30.240495 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 149/291] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:30 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:30.349177 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-5d2f5581-2120-44b8-bec2-f95cb132373e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 28659 microversion: 2.20 time: 0.136062 Nov 21 13:53:30.353147 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 143/292] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:30 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 28659 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:53:30.532194 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-a2be1e34-324c-4f4d-9c56-6d4e1fbe3be9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:30.533274 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-a2be1e34-324c-4f4d-9c56-6d4e1fbe3be9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:30.539477 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a2be1e34-324c-4f4d-9c56-6d4e1fbe3be9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:30.539975 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a2be1e34-324c-4f4d-9c56-6d4e1fbe3be9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:30.540754 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a2be1e34-324c-4f4d-9c56-6d4e1fbe3be9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:30.541191 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a2be1e34-324c-4f4d-9c56-6d4e1fbe3be9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:30.618996 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-a2be1e34-324c-4f4d-9c56-6d4e1fbe3be9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 32431 microversion: 2.1 time: 0.090269 Nov 21 13:53:30.619656 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 150/293] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:30 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 32431 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:30.898350 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-d0f6275b-2737-40fd-ab4f-6ab4387d85ce tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:30.899039 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-d0f6275b-2737-40fd-ab4f-6ab4387d85ce tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] [instance: a010f06f-1270-458b-a306-5e93a074e67a] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:30.905988 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d0f6275b-2737-40fd-ab4f-6ab4387d85ce tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:30.906441 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d0f6275b-2737-40fd-ab4f-6ab4387d85ce tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:30.907197 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d0f6275b-2737-40fd-ab4f-6ab4387d85ce tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:30.907626 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d0f6275b-2737-40fd-ab4f-6ab4387d85ce tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:31.042072 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-d0f6275b-2737-40fd-ab4f-6ab4387d85ce tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788d44a8ed8b429282e923bcd13cf26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fec3a1c72184d41a6e85ec8ece002db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:31.050676 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-d0f6275b-2737-40fd-ab4f-6ab4387d85ce tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a" status: 200 len: 1314 microversion: 2.1 time: 0.156326 Nov 21 13:53:31.051240 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 144/294] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:30 2021] GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:31.259581 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ef2295c6-3608-4be5-b90b-41a659886301 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:31.260989 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ef2295c6-3608-4be5-b90b-41a659886301 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:31.276821 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ef2295c6-3608-4be5-b90b-41a659886301 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:31.277274 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ef2295c6-3608-4be5-b90b-41a659886301 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:31.278071 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ef2295c6-3608-4be5-b90b-41a659886301 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:31.278507 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ef2295c6-3608-4be5-b90b-41a659886301 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:31.361206 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-6c01d9fa-5db4-4b3b-9811-6a82af46b21c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:31.362892 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-6c01d9fa-5db4-4b3b-9811-6a82af46b21c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:31.369774 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6c01d9fa-5db4-4b3b-9811-6a82af46b21c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:31.370221 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6c01d9fa-5db4-4b3b-9811-6a82af46b21c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:31.371006 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6c01d9fa-5db4-4b3b-9811-6a82af46b21c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:31.371440 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6c01d9fa-5db4-4b3b-9811-6a82af46b21c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:31.417056 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-ef2295c6-3608-4be5-b90b-41a659886301 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:31.424479 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ef2295c6-3608-4be5-b90b-41a659886301 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.169340 Nov 21 13:53:31.425045 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 151/295] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:31 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:31.440685 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-6c01d9fa-5db4-4b3b-9811-6a82af46b21c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 28659 microversion: 2.20 time: 0.083267 Nov 21 13:53:31.441348 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 145/296] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:31 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 28659 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:53:31.630978 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-bb93cdac-52c6-4364-9c26-d19406b4abd7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:31.632236 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-bb93cdac-52c6-4364-9c26-d19406b4abd7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:31.638536 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bb93cdac-52c6-4364-9c26-d19406b4abd7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:31.639252 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bb93cdac-52c6-4364-9c26-d19406b4abd7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:31.640148 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bb93cdac-52c6-4364-9c26-d19406b4abd7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:31.640595 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bb93cdac-52c6-4364-9c26-d19406b4abd7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:31.712023 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-503633e4-f423-488b-aa47-1aa9c658baf6 req-fd8ca92d-8cb6-45ba-907a-f0c8ef694330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a010f06f-1270-458b-a306-5e93a074e67a", "name": "network-vif-plugged", "status": "completed", "tag": "cb431e0d-b009-419d-9f2a-352a0a7111d7"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:31.713597 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:53:31.713597 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:53:31.723123 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-503633e4-f423-488b-aa47-1aa9c658baf6 req-fd8ca92d-8cb6-45ba-907a-f0c8ef694330 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:31.723663 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-503633e4-f423-488b-aa47-1aa9c658baf6 req-fd8ca92d-8cb6-45ba-907a-f0c8ef694330 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:31.739214 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-bb93cdac-52c6-4364-9c26-d19406b4abd7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 33216 microversion: 2.1 time: 0.111900 Nov 21 13:53:31.740894 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 152/297] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:31 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 33216 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:31.745252 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-503633e4-f423-488b-aa47-1aa9c658baf6 req-fd8ca92d-8cb6-45ba-907a-f0c8ef694330 service nova] Creating event network-vif-plugged:cb431e0d-b009-419d-9f2a-352a0a7111d7 for instance a010f06f-1270-458b-a306-5e93a074e67a on hv-cinder-76845 Nov 21 13:53:31.749932 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-503633e4-f423-488b-aa47-1aa9c658baf6 req-fd8ca92d-8cb6-45ba-907a-f0c8ef694330 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041989 Nov 21 13:53:31.750694 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 146/298] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:53:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:53:32.068417 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-82f22cf8-e035-42db-8fa2-1bd71fdc4bc7 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:32.069101 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-82f22cf8-e035-42db-8fa2-1bd71fdc4bc7 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] [instance: a010f06f-1270-458b-a306-5e93a074e67a] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:32.075768 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-82f22cf8-e035-42db-8fa2-1bd71fdc4bc7 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:32.076250 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-82f22cf8-e035-42db-8fa2-1bd71fdc4bc7 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:32.077023 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-82f22cf8-e035-42db-8fa2-1bd71fdc4bc7 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:32.077455 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-82f22cf8-e035-42db-8fa2-1bd71fdc4bc7 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:32.220755 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-82f22cf8-e035-42db-8fa2-1bd71fdc4bc7 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788d44a8ed8b429282e923bcd13cf26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fec3a1c72184d41a6e85ec8ece002db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:32.228141 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-82f22cf8-e035-42db-8fa2-1bd71fdc4bc7 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a" status: 200 len: 1314 microversion: 2.1 time: 0.164170 Nov 21 13:53:32.228694 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 153/299] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:32 2021] GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:32.441865 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-113f4be3-a378-4269-968e-5b59b0622982 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:32.442480 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-113f4be3-a378-4269-968e-5b59b0622982 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:32.449276 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-113f4be3-a378-4269-968e-5b59b0622982 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:32.449725 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-113f4be3-a378-4269-968e-5b59b0622982 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:32.450532 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-113f4be3-a378-4269-968e-5b59b0622982 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:32.450963 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-113f4be3-a378-4269-968e-5b59b0622982 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:32.452047 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-e8bfa7d5-9d0d-4482-8705-0bdf1ccf2450 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:32.452967 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-e8bfa7d5-9d0d-4482-8705-0bdf1ccf2450 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:32.459082 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e8bfa7d5-9d0d-4482-8705-0bdf1ccf2450 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:32.459531 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e8bfa7d5-9d0d-4482-8705-0bdf1ccf2450 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:32.460355 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e8bfa7d5-9d0d-4482-8705-0bdf1ccf2450 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:32.460789 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e8bfa7d5-9d0d-4482-8705-0bdf1ccf2450 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:32.536425 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-e8bfa7d5-9d0d-4482-8705-0bdf1ccf2450 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 28659 microversion: 2.20 time: 0.087741 Nov 21 13:53:32.540448 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 154/300] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:32 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 28659 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:53:32.583920 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-113f4be3-a378-4269-968e-5b59b0622982 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:32.591164 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-113f4be3-a378-4269-968e-5b59b0622982 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.154112 Nov 21 13:53:32.591924 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 147/301] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:32 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:32.750959 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-7671915f-571b-4074-8fa5-55197e6b4ce2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:32.752249 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-7671915f-571b-4074-8fa5-55197e6b4ce2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:32.759215 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7671915f-571b-4074-8fa5-55197e6b4ce2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:32.759668 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7671915f-571b-4074-8fa5-55197e6b4ce2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:32.760474 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7671915f-571b-4074-8fa5-55197e6b4ce2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:32.760909 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7671915f-571b-4074-8fa5-55197e6b4ce2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:32.841918 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-7671915f-571b-4074-8fa5-55197e6b4ce2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 33572 microversion: 2.1 time: 0.094777 Nov 21 13:53:32.846697 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 155/302] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:32 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 33572 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:33.245501 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-b5d59614-d1b8-4ce8-b33b-6e4ca2ca64b8 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:33.246735 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-b5d59614-d1b8-4ce8-b33b-6e4ca2ca64b8 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] [instance: a010f06f-1270-458b-a306-5e93a074e67a] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:33.253707 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b5d59614-d1b8-4ce8-b33b-6e4ca2ca64b8 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:33.254057 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b5d59614-d1b8-4ce8-b33b-6e4ca2ca64b8 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:33.254833 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b5d59614-d1b8-4ce8-b33b-6e4ca2ca64b8 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:33.255257 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b5d59614-d1b8-4ce8-b33b-6e4ca2ca64b8 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:33.409796 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-b5d59614-d1b8-4ce8-b33b-6e4ca2ca64b8 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788d44a8ed8b429282e923bcd13cf26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fec3a1c72184d41a6e85ec8ece002db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:33.418483 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-b5d59614-d1b8-4ce8-b33b-6e4ca2ca64b8 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a" status: 200 len: 1314 microversion: 2.1 time: 0.176319 Nov 21 13:53:33.419344 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 148/303] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:33 2021] GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:33.547706 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ff2d7281-56b4-42a9-9d75-c71e02b2eef1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:33.548788 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ff2d7281-56b4-42a9-9d75-c71e02b2eef1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:33.555820 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ff2d7281-56b4-42a9-9d75-c71e02b2eef1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:33.556287 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ff2d7281-56b4-42a9-9d75-c71e02b2eef1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:33.557076 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ff2d7281-56b4-42a9-9d75-c71e02b2eef1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:33.557507 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ff2d7281-56b4-42a9-9d75-c71e02b2eef1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:33.608151 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a8062fdc-b41a-4ebd-ae2e-f47e51db5265 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:33.608764 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a8062fdc-b41a-4ebd-ae2e-f47e51db5265 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:33.615011 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a8062fdc-b41a-4ebd-ae2e-f47e51db5265 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:33.615462 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a8062fdc-b41a-4ebd-ae2e-f47e51db5265 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:33.616269 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a8062fdc-b41a-4ebd-ae2e-f47e51db5265 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:33.616704 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a8062fdc-b41a-4ebd-ae2e-f47e51db5265 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:33.659575 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ff2d7281-56b4-42a9-9d75-c71e02b2eef1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 29160 microversion: 2.20 time: 0.115643 Nov 21 13:53:33.663484 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 156/304] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:33 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 29160 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:53:33.755891 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a8062fdc-b41a-4ebd-ae2e-f47e51db5265 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:33.763342 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a8062fdc-b41a-4ebd-ae2e-f47e51db5265 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.159021 Nov 21 13:53:33.763973 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 149/305] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:33 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:33.855127 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-7fe2d92c-abaa-45f4-af26-0c155ac580da tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:33.856164 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-7fe2d92c-abaa-45f4-af26-0c155ac580da tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:33.863632 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7fe2d92c-abaa-45f4-af26-0c155ac580da tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:33.864112 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7fe2d92c-abaa-45f4-af26-0c155ac580da tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:33.864889 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7fe2d92c-abaa-45f4-af26-0c155ac580da tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:33.865322 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7fe2d92c-abaa-45f4-af26-0c155ac580da tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:33.961102 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-7fe2d92c-abaa-45f4-af26-0c155ac580da tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 34058 microversion: 2.1 time: 0.110040 Nov 21 13:53:33.961745 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 157/306] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:33 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 34058 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:34.436135 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-acf26203-3021-47e3-8e93-8a2bd4bfc753 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:34.436757 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-acf26203-3021-47e3-8e93-8a2bd4bfc753 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] [instance: a010f06f-1270-458b-a306-5e93a074e67a] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:34.442965 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-acf26203-3021-47e3-8e93-8a2bd4bfc753 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:34.443415 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-acf26203-3021-47e3-8e93-8a2bd4bfc753 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:34.444223 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-acf26203-3021-47e3-8e93-8a2bd4bfc753 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:34.444651 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-acf26203-3021-47e3-8e93-8a2bd4bfc753 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:34.587890 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-acf26203-3021-47e3-8e93-8a2bd4bfc753 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788d44a8ed8b429282e923bcd13cf26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fec3a1c72184d41a6e85ec8ece002db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:34.595187 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-acf26203-3021-47e3-8e93-8a2bd4bfc753 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a" status: 200 len: 1463 microversion: 2.1 time: 0.162941 Nov 21 13:53:34.596846 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 150/307] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:34 2021] GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a => generated 1463 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:34.636816 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b69bd804-6cfd-4c9c-b9b2-59f32fa368c7 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:34.637526 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b69bd804-6cfd-4c9c-b9b2-59f32fa368c7 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] [instance: a010f06f-1270-458b-a306-5e93a074e67a] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:34.644305 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b69bd804-6cfd-4c9c-b9b2-59f32fa368c7 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:34.644745 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b69bd804-6cfd-4c9c-b9b2-59f32fa368c7 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:34.645525 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b69bd804-6cfd-4c9c-b9b2-59f32fa368c7 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:34.645956 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b69bd804-6cfd-4c9c-b9b2-59f32fa368c7 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:34.670806 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-be7c9631-e042-4003-a19c-c1c6bbb9e165 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:34.671409 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b69bd804-6cfd-4c9c-b9b2-59f32fa368c7 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] [instance: a010f06f-1270-458b-a306-5e93a074e67a] Going to try to terminate instance {{(pid=122564) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 21 13:53:34.672012 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-be7c9631-e042-4003-a19c-c1c6bbb9e165 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:34.679347 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-be7c9631-e042-4003-a19c-c1c6bbb9e165 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:34.680058 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-be7c9631-e042-4003-a19c-c1c6bbb9e165 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:34.681078 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-be7c9631-e042-4003-a19c-c1c6bbb9e165 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:34.681580 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-be7c9631-e042-4003-a19c-c1c6bbb9e165 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:34.747654 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-b69bd804-6cfd-4c9c-b9b2-59f32fa368c7 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "DELETE /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a" status: 204 len: 0 microversion: 2.1 time: 0.114640 Nov 21 13:53:34.748259 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 158/308] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 13:53:34 2021] DELETE /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 13:53:34.757224 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-31107d09-2bf6-4ffa-a776-dc2396d9ce20 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:34.758077 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-31107d09-2bf6-4ffa-a776-dc2396d9ce20 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] [instance: a010f06f-1270-458b-a306-5e93a074e67a] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:34.764498 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-31107d09-2bf6-4ffa-a776-dc2396d9ce20 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:34.764948 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-31107d09-2bf6-4ffa-a776-dc2396d9ce20 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:34.765722 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-31107d09-2bf6-4ffa-a776-dc2396d9ce20 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:34.766155 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-31107d09-2bf6-4ffa-a776-dc2396d9ce20 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:34.803924 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-be7c9631-e042-4003-a19c-c1c6bbb9e165 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 30573 microversion: 2.20 time: 0.136842 Nov 21 13:53:34.804597 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 151/309] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:34 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 30573 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:53:34.809586 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-bc0a05f5-734d-4f81-8155-808272cc927d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:34.810294 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-bc0a05f5-734d-4f81-8155-808272cc927d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:34.817190 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bc0a05f5-734d-4f81-8155-808272cc927d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:34.817645 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bc0a05f5-734d-4f81-8155-808272cc927d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:34.818421 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bc0a05f5-734d-4f81-8155-808272cc927d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:34.818857 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bc0a05f5-734d-4f81-8155-808272cc927d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:34.901786 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-31107d09-2bf6-4ffa-a776-dc2396d9ce20 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788d44a8ed8b429282e923bcd13cf26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fec3a1c72184d41a6e85ec8ece002db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:34.909988 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-31107d09-2bf6-4ffa-a776-dc2396d9ce20 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a" status: 200 len: 1469 microversion: 2.1 time: 0.156450 Nov 21 13:53:34.912028 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 159/310] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:34 2021] GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:53:34.958355 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bc0a05f5-734d-4f81-8155-808272cc927d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:34.965547 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-bc0a05f5-734d-4f81-8155-808272cc927d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.159696 Nov 21 13:53:34.966211 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 152/311] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:34 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:34.972267 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-aadbdbd8-0f0c-4984-91bc-f197fd67bc3c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:34.973174 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-aadbdbd8-0f0c-4984-91bc-f197fd67bc3c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:34.980745 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-aadbdbd8-0f0c-4984-91bc-f197fd67bc3c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:34.981255 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-aadbdbd8-0f0c-4984-91bc-f197fd67bc3c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:34.982213 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-aadbdbd8-0f0c-4984-91bc-f197fd67bc3c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:34.982665 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-aadbdbd8-0f0c-4984-91bc-f197fd67bc3c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:35.126555 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-aadbdbd8-0f0c-4984-91bc-f197fd67bc3c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 34710 microversion: 2.1 time: 0.158092 Nov 21 13:53:35.127763 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 160/312] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:34 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 34710 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:35.815417 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-43fa43e4-e73e-4ca0-ac05-4039e643a581 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:35.816377 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-43fa43e4-e73e-4ca0-ac05-4039e643a581 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:35.823225 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-43fa43e4-e73e-4ca0-ac05-4039e643a581 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:35.823669 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-43fa43e4-e73e-4ca0-ac05-4039e643a581 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:35.824479 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-43fa43e4-e73e-4ca0-ac05-4039e643a581 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:35.824910 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-43fa43e4-e73e-4ca0-ac05-4039e643a581 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:35.926835 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-20af2e42-2c17-445d-b1f3-9119a4145896 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:35.927448 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-20af2e42-2c17-445d-b1f3-9119a4145896 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] [instance: a010f06f-1270-458b-a306-5e93a074e67a] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:35.934278 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-20af2e42-2c17-445d-b1f3-9119a4145896 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:35.934724 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-20af2e42-2c17-445d-b1f3-9119a4145896 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:35.935500 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-20af2e42-2c17-445d-b1f3-9119a4145896 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:35.935969 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-20af2e42-2c17-445d-b1f3-9119a4145896 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:36.069361 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-20af2e42-2c17-445d-b1f3-9119a4145896 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788d44a8ed8b429282e923bcd13cf26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fec3a1c72184d41a6e85ec8ece002db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:36.076580 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-20af2e42-2c17-445d-b1f3-9119a4145896 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a" status: 200 len: 1469 microversion: 2.1 time: 0.153848 Nov 21 13:53:36.077130 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 161/313] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:35 2021] GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:53:36.081757 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-de7d3bbd-4a81-4c20-9cee-d069de09a7e1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:36.082348 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-de7d3bbd-4a81-4c20-9cee-d069de09a7e1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:36.087786 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-de7d3bbd-4a81-4c20-9cee-d069de09a7e1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:36.088272 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-de7d3bbd-4a81-4c20-9cee-d069de09a7e1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:36.089046 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-de7d3bbd-4a81-4c20-9cee-d069de09a7e1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:36.089473 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-de7d3bbd-4a81-4c20-9cee-d069de09a7e1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:36.221010 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-de7d3bbd-4a81-4c20-9cee-d069de09a7e1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:36.228067 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-de7d3bbd-4a81-4c20-9cee-d069de09a7e1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.149980 Nov 21 13:53:36.228641 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 162/314] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:36 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:36.232943 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-551c4373-be63-4236-bb00-fcd48c369b31 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:36.233858 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-551c4373-be63-4236-bb00-fcd48c369b31 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:36.239213 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-551c4373-be63-4236-bb00-fcd48c369b31 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:36.239653 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-551c4373-be63-4236-bb00-fcd48c369b31 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:36.240450 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-551c4373-be63-4236-bb00-fcd48c369b31 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:36.240877 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-551c4373-be63-4236-bb00-fcd48c369b31 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:38.601071 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-43fa43e4-e73e-4ca0-ac05-4039e643a581 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 34862 microversion: 2.20 time: 2.789158 Nov 21 13:53:38.601744 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 153/315] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:35 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 34862 bytes in 2791 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:53:38.608599 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-5aec761d-0fd7-4314-8578-1849a33f9dde tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:38.609548 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-5aec761d-0fd7-4314-8578-1849a33f9dde tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] [instance: a010f06f-1270-458b-a306-5e93a074e67a] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:38.616548 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5aec761d-0fd7-4314-8578-1849a33f9dde tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:38.616993 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5aec761d-0fd7-4314-8578-1849a33f9dde tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:38.617764 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5aec761d-0fd7-4314-8578-1849a33f9dde tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:38.618191 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5aec761d-0fd7-4314-8578-1849a33f9dde tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:38.633121 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-551c4373-be63-4236-bb00-fcd48c369b31 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 36537 microversion: 2.1 time: 2.403254 Nov 21 13:53:38.633757 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 163/316] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:36 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 36537 bytes in 2405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:38.642157 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-61900bc7-5dd2-4058-8f5c-c434bc452175 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:38.642843 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-61900bc7-5dd2-4058-8f5c-c434bc452175 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:38.649639 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-61900bc7-5dd2-4058-8f5c-c434bc452175 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:38.650090 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-61900bc7-5dd2-4058-8f5c-c434bc452175 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:38.652134 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-61900bc7-5dd2-4058-8f5c-c434bc452175 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:38.652589 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-61900bc7-5dd2-4058-8f5c-c434bc452175 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:38.759096 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-5aec761d-0fd7-4314-8578-1849a33f9dde tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788d44a8ed8b429282e923bcd13cf26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fec3a1c72184d41a6e85ec8ece002db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:38.766622 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-5aec761d-0fd7-4314-8578-1849a33f9dde tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a" status: 200 len: 1469 microversion: 2.1 time: 0.161773 Nov 21 13:53:38.767200 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 154/317] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:38 2021] GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a => generated 1469 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:38.795614 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-61900bc7-5dd2-4058-8f5c-c434bc452175 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:38.803479 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-61900bc7-5dd2-4058-8f5c-c434bc452175 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.165041 Nov 21 13:53:38.804064 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 164/318] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:38 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:39.612456 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-fa76fd40-149e-42a9-a21c-98b7cc6ad750 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:39.613369 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-fa76fd40-149e-42a9-a21c-98b7cc6ad750 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:39.619676 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fa76fd40-149e-42a9-a21c-98b7cc6ad750 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:39.620165 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fa76fd40-149e-42a9-a21c-98b7cc6ad750 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:39.620949 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fa76fd40-149e-42a9-a21c-98b7cc6ad750 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:39.621384 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fa76fd40-149e-42a9-a21c-98b7cc6ad750 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:39.645477 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-4768c6b6-3335-4c37-b23a-73ee04b72671 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:39.646594 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-4768c6b6-3335-4c37-b23a-73ee04b72671 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:39.655103 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4768c6b6-3335-4c37-b23a-73ee04b72671 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:39.656523 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4768c6b6-3335-4c37-b23a-73ee04b72671 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:39.657527 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4768c6b6-3335-4c37-b23a-73ee04b72671 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:39.659440 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4768c6b6-3335-4c37-b23a-73ee04b72671 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:39.746624 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-4768c6b6-3335-4c37-b23a-73ee04b72671 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 37077 microversion: 2.1 time: 0.105630 Nov 21 13:53:39.747298 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 165/319] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:39 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 37077 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 13:53:39.783630 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-fa76fd40-149e-42a9-a21c-98b7cc6ad750 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 35255 microversion: 2.20 time: 0.174694 Nov 21 13:53:39.788027 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 155/320] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:39 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 35255 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:53:39.788198 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-f789dd78-aa4d-4e3d-bf40-9a45e7dab5e1 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:39.788198 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-f789dd78-aa4d-4e3d-bf40-9a45e7dab5e1 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] [instance: a010f06f-1270-458b-a306-5e93a074e67a] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:39.794337 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f789dd78-aa4d-4e3d-bf40-9a45e7dab5e1 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:39.794898 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f789dd78-aa4d-4e3d-bf40-9a45e7dab5e1 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:39.795997 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f789dd78-aa4d-4e3d-bf40-9a45e7dab5e1 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:39.796560 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f789dd78-aa4d-4e3d-bf40-9a45e7dab5e1 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:39.821776 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-52f05b26-bf9c-46c5-bb5f-c748f63d6bba tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:39.822404 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-52f05b26-bf9c-46c5-bb5f-c748f63d6bba tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:39.828672 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-52f05b26-bf9c-46c5-bb5f-c748f63d6bba tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:39.832130 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-52f05b26-bf9c-46c5-bb5f-c748f63d6bba tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:39.833063 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-52f05b26-bf9c-46c5-bb5f-c748f63d6bba tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:39.833621 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-52f05b26-bf9c-46c5-bb5f-c748f63d6bba tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:39.978860 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-f789dd78-aa4d-4e3d-bf40-9a45e7dab5e1 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788d44a8ed8b429282e923bcd13cf26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fec3a1c72184d41a6e85ec8ece002db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:39.986874 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-f789dd78-aa4d-4e3d-bf40-9a45e7dab5e1 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a" status: 200 len: 1469 microversion: 2.1 time: 0.206818 Nov 21 13:53:39.987577 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 166/321] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:39 2021] GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a => generated 1469 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:53:40.059214 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-52f05b26-bf9c-46c5-bb5f-c748f63d6bba tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:40.067663 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-52f05b26-bf9c-46c5-bb5f-c748f63d6bba tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.250205 Nov 21 13:53:40.068630 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 156/322] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:39 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:53:40.438098 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-11730ff7-0b05-4189-8ae2-18fe687422ea req-1e1db0b1-2e65-46b3-9ef0-a7daead600c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a010f06f-1270-458b-a306-5e93a074e67a", "name": "network-vif-deleted", "tag": "cb431e0d-b009-419d-9f2a-352a0a7111d7"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:40.439839 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:53:40.439839 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:53:40.447485 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-11730ff7-0b05-4189-8ae2-18fe687422ea req-1e1db0b1-2e65-46b3-9ef0-a7daead600c5 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:40.447954 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-11730ff7-0b05-4189-8ae2-18fe687422ea req-1e1db0b1-2e65-46b3-9ef0-a7daead600c5 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:40.461950 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-11730ff7-0b05-4189-8ae2-18fe687422ea req-1e1db0b1-2e65-46b3-9ef0-a7daead600c5 service nova] Creating event network-vif-deleted:cb431e0d-b009-419d-9f2a-352a0a7111d7 for instance a010f06f-1270-458b-a306-5e93a074e67a on hv-cinder-76845 Nov 21 13:53:40.467744 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-11730ff7-0b05-4189-8ae2-18fe687422ea req-1e1db0b1-2e65-46b3-9ef0-a7daead600c5 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033326 Nov 21 13:53:40.468317 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 167/323] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:53:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:53:40.760752 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-e7c1d228-8e1c-4b0b-b34e-e7c7582dcf5f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:40.761675 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-e7c1d228-8e1c-4b0b-b34e-e7c7582dcf5f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:40.768216 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e7c1d228-8e1c-4b0b-b34e-e7c7582dcf5f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:40.768659 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e7c1d228-8e1c-4b0b-b34e-e7c7582dcf5f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:40.769422 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e7c1d228-8e1c-4b0b-b34e-e7c7582dcf5f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:40.769850 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e7c1d228-8e1c-4b0b-b34e-e7c7582dcf5f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:40.796198 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-00ce51b7-da7c-4ac0-83c8-d421e4c5d5d3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:40.797215 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-00ce51b7-da7c-4ac0-83c8-d421e4c5d5d3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:40.803161 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-00ce51b7-da7c-4ac0-83c8-d421e4c5d5d3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:40.803607 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-00ce51b7-da7c-4ac0-83c8-d421e4c5d5d3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:40.804416 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-00ce51b7-da7c-4ac0-83c8-d421e4c5d5d3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:40.804852 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-00ce51b7-da7c-4ac0-83c8-d421e4c5d5d3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:40.866776 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-e7c1d228-8e1c-4b0b-b34e-e7c7582dcf5f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 37876 microversion: 2.1 time: 0.111617 Nov 21 13:53:40.867478 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 157/324] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:40 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 37876 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:40.896168 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-00ce51b7-da7c-4ac0-83c8-d421e4c5d5d3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 35666 microversion: 2.20 time: 0.104250 Nov 21 13:53:40.897010 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 168/325] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:40 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 35666 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:53:41.004147 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a4d7910f-bff9-4856-94cb-8a8090d0ac83 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:41.004837 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a4d7910f-bff9-4856-94cb-8a8090d0ac83 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] [instance: a010f06f-1270-458b-a306-5e93a074e67a] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:41.011654 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a4d7910f-bff9-4856-94cb-8a8090d0ac83 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:41.012072 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a4d7910f-bff9-4856-94cb-8a8090d0ac83 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:41.012884 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a4d7910f-bff9-4856-94cb-8a8090d0ac83 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:41.013320 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a4d7910f-bff9-4856-94cb-8a8090d0ac83 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:41.045412 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a4d7910f-bff9-4856-94cb-8a8090d0ac83 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:41.045864 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a4d7910f-bff9-4856-94cb-8a8090d0ac83 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:41.046310 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.objects.instance [None req-a4d7910f-bff9-4856-94cb-8a8090d0ac83 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lazy-loading 'fault' on Instance uuid a010f06f-1270-458b-a306-5e93a074e67a {{(pid=122565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:53:41.084911 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-e571b8b1-1bc0-4b3a-8c4d-533f6bb66d71 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:41.085745 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-e571b8b1-1bc0-4b3a-8c4d-533f6bb66d71 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:41.092417 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e571b8b1-1bc0-4b3a-8c4d-533f6bb66d71 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:41.093311 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e571b8b1-1bc0-4b3a-8c4d-533f6bb66d71 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:41.093628 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e571b8b1-1bc0-4b3a-8c4d-533f6bb66d71 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:41.094057 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e571b8b1-1bc0-4b3a-8c4d-533f6bb66d71 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:41.095172 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a4d7910f-bff9-4856-94cb-8a8090d0ac83 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788d44a8ed8b429282e923bcd13cf26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fec3a1c72184d41a6e85ec8ece002db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:41.101860 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a4d7910f-bff9-4856-94cb-8a8090d0ac83 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a" status: 200 len: 1304 microversion: 2.1 time: 0.102323 Nov 21 13:53:41.102538 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 158/326] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:40 2021] GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:41.226462 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-e571b8b1-1bc0-4b3a-8c4d-533f6bb66d71 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:41.234483 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-e571b8b1-1bc0-4b3a-8c4d-533f6bb66d71 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.153604 Nov 21 13:53:41.235212 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 169/327] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:41 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:53:41.878990 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-4de19b0d-f19a-4120-a3a9-26fbcdd3924e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:41.879943 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-4de19b0d-f19a-4120-a3a9-26fbcdd3924e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:41.886898 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4de19b0d-f19a-4120-a3a9-26fbcdd3924e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:41.887431 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4de19b0d-f19a-4120-a3a9-26fbcdd3924e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:41.888236 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4de19b0d-f19a-4120-a3a9-26fbcdd3924e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:41.888675 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4de19b0d-f19a-4120-a3a9-26fbcdd3924e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:41.908738 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-12dc2792-a1a2-42e6-b47c-a1be3ef3dd7a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:41.909655 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-12dc2792-a1a2-42e6-b47c-a1be3ef3dd7a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:41.916379 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-12dc2792-a1a2-42e6-b47c-a1be3ef3dd7a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:41.916835 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-12dc2792-a1a2-42e6-b47c-a1be3ef3dd7a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:41.917642 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-12dc2792-a1a2-42e6-b47c-a1be3ef3dd7a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:41.918089 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-12dc2792-a1a2-42e6-b47c-a1be3ef3dd7a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:43.894145 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-4de19b0d-f19a-4120-a3a9-26fbcdd3924e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 38094 microversion: 2.1 time: 2.018936 Nov 21 13:53:43.895189 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 159/328] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:41 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 38094 bytes in 2021 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:43.899842 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-fc82606a-f861-4d5c-a1d0-23a6fb87c751 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:43.900551 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-fc82606a-f861-4d5c-a1d0-23a6fb87c751 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] [instance: a010f06f-1270-458b-a306-5e93a074e67a] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:43.908450 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fc82606a-f861-4d5c-a1d0-23a6fb87c751 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:43.908907 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fc82606a-f861-4d5c-a1d0-23a6fb87c751 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:43.909895 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fc82606a-f861-4d5c-a1d0-23a6fb87c751 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:43.910339 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fc82606a-f861-4d5c-a1d0-23a6fb87c751 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:43.925120 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-fc82606a-f861-4d5c-a1d0-23a6fb87c751 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] HTTP exception thrown: Instance a010f06f-1270-458b-a306-5e93a074e67a could not be found. Nov 21 13:53:43.925721 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-fc82606a-f861-4d5c-a1d0-23a6fb87c751 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Returning 404 to user: Instance a010f06f-1270-458b-a306-5e93a074e67a could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:53:43.926545 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-fc82606a-f861-4d5c-a1d0-23a6fb87c751 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a" status: 404 len: 111 microversion: 2.1 time: 0.030554 Nov 21 13:53:43.927078 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 160/329] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:43 2021] GET /compute/v2.1/servers/a010f06f-1270-458b-a306-5e93a074e67a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:53:43.931313 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-3c6c8fef-93a3-4b77-9279-3fe4f0593f83 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:43.931953 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-3c6c8fef-93a3-4b77-9279-3fe4f0593f83 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:43.937532 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3c6c8fef-93a3-4b77-9279-3fe4f0593f83 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:43.937990 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3c6c8fef-93a3-4b77-9279-3fe4f0593f83 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:43.938778 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3c6c8fef-93a3-4b77-9279-3fe4f0593f83 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:43.939214 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3c6c8fef-93a3-4b77-9279-3fe4f0593f83 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:44.080892 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-3c6c8fef-93a3-4b77-9279-3fe4f0593f83 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:44.094756 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-3c6c8fef-93a3-4b77-9279-3fe4f0593f83 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.166661 Nov 21 13:53:44.096009 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 161/330] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:43 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:44.905718 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-3a83a564-4ebc-4605-98c6-db1d8158fb16 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:44.906727 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-3a83a564-4ebc-4605-98c6-db1d8158fb16 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:44.913006 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3a83a564-4ebc-4605-98c6-db1d8158fb16 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:44.913457 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3a83a564-4ebc-4605-98c6-db1d8158fb16 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:44.914366 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3a83a564-4ebc-4605-98c6-db1d8158fb16 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:44.914801 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3a83a564-4ebc-4605-98c6-db1d8158fb16 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:44.980005 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-12dc2792-a1a2-42e6-b47c-a1be3ef3dd7a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 38054 microversion: 2.20 time: 3.075393 Nov 21 13:53:44.984469 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 170/331] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:41 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 38054 bytes in 3077 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:53:45.032521 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-3a83a564-4ebc-4605-98c6-db1d8158fb16 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 200 len: 38217 microversion: 2.1 time: 0.130213 Nov 21 13:53:45.033383 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 162/332] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:44 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 38217 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 13:53:45.044013 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b8ed574f-bc1b-48bb-956f-75f3a7f25f86 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:45.044233 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b8ed574f-bc1b-48bb-956f-75f3a7f25f86 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:45.052139 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b8ed574f-bc1b-48bb-956f-75f3a7f25f86 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:45.052653 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b8ed574f-bc1b-48bb-956f-75f3a7f25f86 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:45.053583 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b8ed574f-bc1b-48bb-956f-75f3a7f25f86 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:45.054042 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b8ed574f-bc1b-48bb-956f-75f3a7f25f86 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:45.079692 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-b8ed574f-bc1b-48bb-956f-75f3a7f25f86 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/ips" status: 200 len: 146 microversion: 2.1 time: 0.040201 Nov 21 13:53:45.080447 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 171/333] 10.222.0.11 () {58 vars in 1247 bytes} [Sun Nov 21 13:53:45 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:53:45.116876 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-050d1e10-a25f-4c68-827b-a280cad09ff4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:45.117574 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-050d1e10-a25f-4c68-827b-a280cad09ff4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:45.125157 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-050d1e10-a25f-4c68-827b-a280cad09ff4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:45.125609 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-050d1e10-a25f-4c68-827b-a280cad09ff4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:45.126424 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-050d1e10-a25f-4c68-827b-a280cad09ff4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:45.127685 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-050d1e10-a25f-4c68-827b-a280cad09ff4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:45.266587 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-050d1e10-a25f-4c68-827b-a280cad09ff4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:45.274021 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-050d1e10-a25f-4c68-827b-a280cad09ff4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.160993 Nov 21 13:53:45.274585 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 163/334] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:45 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:45.991901 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-fa6afe55-c75c-4fed-8ab0-6dca2f8f5d53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:45.992819 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-fa6afe55-c75c-4fed-8ab0-6dca2f8f5d53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:46.000033 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fa6afe55-c75c-4fed-8ab0-6dca2f8f5d53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:46.000514 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fa6afe55-c75c-4fed-8ab0-6dca2f8f5d53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:46.001310 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fa6afe55-c75c-4fed-8ab0-6dca2f8f5d53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:46.002742 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fa6afe55-c75c-4fed-8ab0-6dca2f8f5d53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:46.086310 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-fa6afe55-c75c-4fed-8ab0-6dca2f8f5d53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 38123 microversion: 2.20 time: 0.097880 Nov 21 13:53:46.087005 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 172/335] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:45 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 38123 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:53:46.295231 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-64b904a9-e553-426d-a387-38db6d71976e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:46.295883 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-64b904a9-e553-426d-a387-38db6d71976e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:46.302226 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-64b904a9-e553-426d-a387-38db6d71976e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:46.302682 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-64b904a9-e553-426d-a387-38db6d71976e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:46.303466 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-64b904a9-e553-426d-a387-38db6d71976e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:46.303931 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-64b904a9-e553-426d-a387-38db6d71976e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:46.455038 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-64b904a9-e553-426d-a387-38db6d71976e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:46.463142 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-64b904a9-e553-426d-a387-38db6d71976e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.171682 Nov 21 13:53:46.463723 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 164/336] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:46 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:47.106173 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-7b631221-1b27-469b-92a6-1c3c12e71741 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:47.108817 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-7b631221-1b27-469b-92a6-1c3c12e71741 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:47.119339 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7b631221-1b27-469b-92a6-1c3c12e71741 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:47.119843 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7b631221-1b27-469b-92a6-1c3c12e71741 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:47.120699 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7b631221-1b27-469b-92a6-1c3c12e71741 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:47.121325 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7b631221-1b27-469b-92a6-1c3c12e71741 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:47.202416 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-7b631221-1b27-469b-92a6-1c3c12e71741 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 38123 microversion: 2.20 time: 0.106654 Nov 21 13:53:47.203218 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 173/337] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:47 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 38123 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:53:47.480239 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-90293e61-5450-465c-94ca-dd3252def58d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:47.480847 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-90293e61-5450-465c-94ca-dd3252def58d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:47.487250 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-90293e61-5450-465c-94ca-dd3252def58d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:47.487698 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-90293e61-5450-465c-94ca-dd3252def58d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:47.488505 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-90293e61-5450-465c-94ca-dd3252def58d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:47.488932 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-90293e61-5450-465c-94ca-dd3252def58d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:47.623725 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-90293e61-5450-465c-94ca-dd3252def58d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:47.634160 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-90293e61-5450-465c-94ca-dd3252def58d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.157424 Nov 21 13:53:47.634810 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 165/338] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:47 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:48.223245 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-179a1d07-2f26-4a56-bb5e-1007f499a1bf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:48.224306 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-179a1d07-2f26-4a56-bb5e-1007f499a1bf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:48.253919 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-179a1d07-2f26-4a56-bb5e-1007f499a1bf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:48.254532 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-179a1d07-2f26-4a56-bb5e-1007f499a1bf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:48.255478 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-179a1d07-2f26-4a56-bb5e-1007f499a1bf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:48.255992 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-179a1d07-2f26-4a56-bb5e-1007f499a1bf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:48.276538 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-863f6c93-9849-4f2c-a063-2179aef1103d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e8d26eb-9752-41df-b589-56703e6b2b9a"}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:48.278117 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-863f6c93-9849-4f2c-a063-2179aef1103d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:48.286433 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-863f6c93-9849-4f2c-a063-2179aef1103d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:48.287990 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-863f6c93-9849-4f2c-a063-2179aef1103d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:48.289104 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-863f6c93-9849-4f2c-a063-2179aef1103d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:48.289626 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-863f6c93-9849-4f2c-a063-2179aef1103d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:48.355073 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-179a1d07-2f26-4a56-bb5e-1007f499a1bf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 38129 microversion: 2.20 time: 0.142350 Nov 21 13:53:48.355879 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 174/339] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:48 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 38129 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:53:48.575783 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-863f6c93-9849-4f2c-a063-2179aef1103d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302414 Nov 21 13:53:48.576419 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 166/340] 10.222.0.11 () {60 vars in 1322 bytes} [Sun Nov 21 13:53:48 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:53:48.652536 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ef1b4aa8-5a0f-4b22-be2f-3f925eb0386c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:48.653262 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ef1b4aa8-5a0f-4b22-be2f-3f925eb0386c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:48.662117 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ef1b4aa8-5a0f-4b22-be2f-3f925eb0386c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:48.662781 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ef1b4aa8-5a0f-4b22-be2f-3f925eb0386c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:48.663731 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ef1b4aa8-5a0f-4b22-be2f-3f925eb0386c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:48.664386 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ef1b4aa8-5a0f-4b22-be2f-3f925eb0386c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:48.806522 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-ef1b4aa8-5a0f-4b22-be2f-3f925eb0386c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:48.819392 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ef1b4aa8-5a0f-4b22-be2f-3f925eb0386c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.171158 Nov 21 13:53:48.820215 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 175/341] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:48 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:49.367991 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-0852c37d-2966-45e8-83cd-9a5378710636 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:49.369403 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-0852c37d-2966-45e8-83cd-9a5378710636 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:49.376919 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0852c37d-2966-45e8-83cd-9a5378710636 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:49.378015 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0852c37d-2966-45e8-83cd-9a5378710636 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:49.378800 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0852c37d-2966-45e8-83cd-9a5378710636 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:49.379400 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0852c37d-2966-45e8-83cd-9a5378710636 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:49.462650 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-0852c37d-2966-45e8-83cd-9a5378710636 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 200 len: 38264 microversion: 2.20 time: 0.098919 Nov 21 13:53:49.463700 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 167/342] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:49 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 38264 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:53:49.474132 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-c537b8de-d8b6-4b8a-861c-f022ebea3b67 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:49.475206 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-c537b8de-d8b6-4b8a-861c-f022ebea3b67 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:49.482682 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c537b8de-d8b6-4b8a-861c-f022ebea3b67 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:49.483210 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c537b8de-d8b6-4b8a-861c-f022ebea3b67 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:49.484150 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c537b8de-d8b6-4b8a-861c-f022ebea3b67 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:49.484675 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c537b8de-d8b6-4b8a-861c-f022ebea3b67 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:49.513788 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-c537b8de-d8b6-4b8a-861c-f022ebea3b67 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/ips" status: 200 len: 153 microversion: 2.20 time: 0.044169 Nov 21 13:53:49.514395 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 176/343] 10.222.0.11 () {60 vars in 1288 bytes} [Sun Nov 21 13:53:49 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/ips => generated 153 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:53:49.840449 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-36160eb4-049f-4be9-8ded-eb31ad2948f0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:49.841465 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-36160eb4-049f-4be9-8ded-eb31ad2948f0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:49.849465 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-36160eb4-049f-4be9-8ded-eb31ad2948f0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:49.849969 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-36160eb4-049f-4be9-8ded-eb31ad2948f0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:49.850756 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-36160eb4-049f-4be9-8ded-eb31ad2948f0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:49.851186 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-36160eb4-049f-4be9-8ded-eb31ad2948f0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:49.993385 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-36160eb4-049f-4be9-8ded-eb31ad2948f0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:50.000625 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-36160eb4-049f-4be9-8ded-eb31ad2948f0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.167913 Nov 21 13:53:50.001181 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 168/344] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:49 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:51.017889 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-cf6a805f-66be-487b-9577-9c577854da96 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:51.018439 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-cf6a805f-66be-487b-9577-9c577854da96 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:51.024707 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cf6a805f-66be-487b-9577-9c577854da96 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:51.025166 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cf6a805f-66be-487b-9577-9c577854da96 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:51.025944 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cf6a805f-66be-487b-9577-9c577854da96 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:51.026385 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cf6a805f-66be-487b-9577-9c577854da96 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:51.153994 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-cf6a805f-66be-487b-9577-9c577854da96 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:51.161326 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-cf6a805f-66be-487b-9577-9c577854da96 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.147140 Nov 21 13:53:51.161884 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 177/345] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:51 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:52.178451 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-70efcbb3-7167-48e9-9c01-b179b5101f78 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:52.179054 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-70efcbb3-7167-48e9-9c01-b179b5101f78 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:52.185232 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-70efcbb3-7167-48e9-9c01-b179b5101f78 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:52.185678 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-70efcbb3-7167-48e9-9c01-b179b5101f78 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:52.186439 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-70efcbb3-7167-48e9-9c01-b179b5101f78 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:52.186866 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-70efcbb3-7167-48e9-9c01-b179b5101f78 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:52.315966 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-70efcbb3-7167-48e9-9c01-b179b5101f78 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:52.324786 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-70efcbb3-7167-48e9-9c01-b179b5101f78 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.150599 Nov 21 13:53:52.325345 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 169/346] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:52 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:53.340487 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-3e44e3ba-e5b0-421f-aeb4-cf0bacaa3726 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:53.341117 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3e44e3ba-e5b0-421f-aeb4-cf0bacaa3726 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:53.347337 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3e44e3ba-e5b0-421f-aeb4-cf0bacaa3726 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:53.347789 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3e44e3ba-e5b0-421f-aeb4-cf0bacaa3726 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:53.348601 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3e44e3ba-e5b0-421f-aeb4-cf0bacaa3726 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:53.349035 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3e44e3ba-e5b0-421f-aeb4-cf0bacaa3726 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:53.477286 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-3e44e3ba-e5b0-421f-aeb4-cf0bacaa3726 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:53.484737 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-3e44e3ba-e5b0-421f-aeb4-cf0bacaa3726 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.147758 Nov 21 13:53:53.485315 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 178/347] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:53 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:54.502237 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-05818daa-8994-4e06-9151-384ee1329e1e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:54.502847 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-05818daa-8994-4e06-9151-384ee1329e1e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:54.509094 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-05818daa-8994-4e06-9151-384ee1329e1e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:54.509517 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-05818daa-8994-4e06-9151-384ee1329e1e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:54.510295 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-05818daa-8994-4e06-9151-384ee1329e1e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:54.510731 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-05818daa-8994-4e06-9151-384ee1329e1e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:54.781170 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-05818daa-8994-4e06-9151-384ee1329e1e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:54.788497 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-05818daa-8994-4e06-9151-384ee1329e1e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.290182 Nov 21 13:53:54.789061 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 170/348] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:54 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:55.197573 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-06c064ec-a89d-4892-bded-74766d2b6d99 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:55.198136 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-06c064ec-a89d-4892-bded-74766d2b6d99 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:55.210631 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-06c064ec-a89d-4892-bded-74766d2b6d99 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:55.211204 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-06c064ec-a89d-4892-bded-74766d2b6d99 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:55.211910 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-06c064ec-a89d-4892-bded-74766d2b6d99 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:55.212352 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-06c064ec-a89d-4892-bded-74766d2b6d99 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:55.239249 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.objects.instance [None req-06c064ec-a89d-4892-bded-74766d2b6d99 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lazy-loading 'flavor' on Instance uuid 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 {{(pid=122564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:53:55.524222 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-06c064ec-a89d-4892-bded-74766d2b6d99 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 202 len: 0 microversion: 2.20 time: 0.331067 Nov 21 13:53:55.528072 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 179/349] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:53:55 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 21 13:53:55.533253 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-7baceeec-8bdc-4e39-a013-a1765446752e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:55.534024 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-7baceeec-8bdc-4e39-a013-a1765446752e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:55.549761 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7baceeec-8bdc-4e39-a013-a1765446752e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:55.550215 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7baceeec-8bdc-4e39-a013-a1765446752e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:55.551218 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7baceeec-8bdc-4e39-a013-a1765446752e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:55.551660 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7baceeec-8bdc-4e39-a013-a1765446752e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:55.685041 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-7baceeec-8bdc-4e39-a013-a1765446752e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:55.693403 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-7baceeec-8bdc-4e39-a013-a1765446752e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:55.694998 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-7baceeec-8bdc-4e39-a013-a1765446752e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:55.696180 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-7baceeec-8bdc-4e39-a013-a1765446752e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.166855 Nov 21 13:53:55.696730 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 171/350] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:53:55 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:53:55.806328 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ce93231e-5b53-4efc-ae2c-c1a5ef0dedb6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:55.807013 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ce93231e-5b53-4efc-ae2c-c1a5ef0dedb6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:55.813149 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ce93231e-5b53-4efc-ae2c-c1a5ef0dedb6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:55.813591 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ce93231e-5b53-4efc-ae2c-c1a5ef0dedb6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:55.814359 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ce93231e-5b53-4efc-ae2c-c1a5ef0dedb6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:55.814790 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ce93231e-5b53-4efc-ae2c-c1a5ef0dedb6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:55.946179 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-ce93231e-5b53-4efc-ae2c-c1a5ef0dedb6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:55.953926 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ce93231e-5b53-4efc-ae2c-c1a5ef0dedb6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.151606 Nov 21 13:53:55.954651 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 180/351] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:55 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:56.060758 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-74ab6536-bca5-47ca-885d-c9b928cd1b91 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:56.067208 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-74ab6536-bca5-47ca-885d-c9b928cd1b91 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:56.067658 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-74ab6536-bca5-47ca-885d-c9b928cd1b91 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:56.127825 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-74ab6536-bca5-47ca-885d-c9b928cd1b91 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Going to try to stop instance {{(pid=122565) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 21 13:53:56.171880 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-74ab6536-bca5-47ca-885d-c9b928cd1b91 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 202 len: 0 microversion: 2.1 time: 0.114173 Nov 21 13:53:56.172677 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 172/352] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:56 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:53:56.180932 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-8ee2d4e8-9740-407e-b5c5-c8d9b7d053f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:56.181549 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-8ee2d4e8-9740-407e-b5c5-c8d9b7d053f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:56.187294 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8ee2d4e8-9740-407e-b5c5-c8d9b7d053f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:56.187779 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8ee2d4e8-9740-407e-b5c5-c8d9b7d053f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:56.188626 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8ee2d4e8-9740-407e-b5c5-c8d9b7d053f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:56.189083 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8ee2d4e8-9740-407e-b5c5-c8d9b7d053f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:56.323283 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-8ee2d4e8-9740-407e-b5c5-c8d9b7d053f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:56.331181 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-8ee2d4e8-9740-407e-b5c5-c8d9b7d053f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1723 microversion: 2.1 time: 0.153845 Nov 21 13:53:56.331739 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 181/353] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:56 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:56.714830 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-bc3894a0-8fc6-4317-9840-fc2ea15888c3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:56.715524 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-bc3894a0-8fc6-4317-9840-fc2ea15888c3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:56.721835 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bc3894a0-8fc6-4317-9840-fc2ea15888c3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:56.722282 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bc3894a0-8fc6-4317-9840-fc2ea15888c3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:56.723728 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bc3894a0-8fc6-4317-9840-fc2ea15888c3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:56.724188 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bc3894a0-8fc6-4317-9840-fc2ea15888c3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:56.856253 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bc3894a0-8fc6-4317-9840-fc2ea15888c3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:56.864896 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bc3894a0-8fc6-4317-9840-fc2ea15888c3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:56.866428 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bc3894a0-8fc6-4317-9840-fc2ea15888c3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:56.867593 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-bc3894a0-8fc6-4317-9840-fc2ea15888c3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.156821 Nov 21 13:53:56.868186 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 173/354] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:53:56 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:53:56.975354 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-4636fd5e-7345-418c-bdab-10828be3d5a6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:56.976011 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-4636fd5e-7345-418c-bdab-10828be3d5a6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:56.982140 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4636fd5e-7345-418c-bdab-10828be3d5a6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:56.982586 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4636fd5e-7345-418c-bdab-10828be3d5a6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:56.983383 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4636fd5e-7345-418c-bdab-10828be3d5a6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:56.983840 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4636fd5e-7345-418c-bdab-10828be3d5a6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:57.111056 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-4636fd5e-7345-418c-bdab-10828be3d5a6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:57.118910 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-4636fd5e-7345-418c-bdab-10828be3d5a6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1501 microversion: 2.1 time: 0.147452 Nov 21 13:53:57.119477 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 182/355] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:56 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1501 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:57.136876 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-18278247-7036-457f-8cac-deb8fd1efb6a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6105fad-6772-4307-a67e-6d3223fba84d"}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:57.138227 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-18278247-7036-457f-8cac-deb8fd1efb6a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:57.145092 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-18278247-7036-457f-8cac-deb8fd1efb6a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:57.145567 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-18278247-7036-457f-8cac-deb8fd1efb6a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:57.146366 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-18278247-7036-457f-8cac-deb8fd1efb6a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:57.146806 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-18278247-7036-457f-8cac-deb8fd1efb6a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:57.173150 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-18278247-7036-457f-8cac-deb8fd1efb6a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] HTTP exception thrown: Cannot 'attach_volume' instance 2d1c9d3d-f088-4d2f-b2bc-e26543509aae while it is in vm_state rescued Nov 21 13:53:57.173743 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-18278247-7036-457f-8cac-deb8fd1efb6a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Returning 409 to user: Cannot 'attach_volume' instance 2d1c9d3d-f088-4d2f-b2bc-e26543509aae while it is in vm_state rescued {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:53:57.174559 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-18278247-7036-457f-8cac-deb8fd1efb6a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "POST /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041766 Nov 21 13:53:57.175223 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 174/356] 10.222.0.11 () {60 vars in 1322 bytes} [Sun Nov 21 13:53:57 2021] POST /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 21 13:53:57.183392 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-a97e5200-92ed-44be-828d-e48db70969c2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:57.183956 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-a97e5200-92ed-44be-828d-e48db70969c2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:57.189635 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a97e5200-92ed-44be-828d-e48db70969c2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:57.190083 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a97e5200-92ed-44be-828d-e48db70969c2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:57.190855 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a97e5200-92ed-44be-828d-e48db70969c2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:57.191844 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a97e5200-92ed-44be-828d-e48db70969c2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:57.254557 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-a97e5200-92ed-44be-828d-e48db70969c2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "POST /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae/action" status: 202 len: 0 microversion: 2.1 time: 0.074036 Nov 21 13:53:57.255126 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 183/357] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:53:57 2021] POST /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:53:57.262954 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-0c9e5f09-e84c-4d4e-b437-94d392f88546 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:57.263562 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-0c9e5f09-e84c-4d4e-b437-94d392f88546 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:57.270139 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0c9e5f09-e84c-4d4e-b437-94d392f88546 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:57.270880 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0c9e5f09-e84c-4d4e-b437-94d392f88546 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:57.271823 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0c9e5f09-e84c-4d4e-b437-94d392f88546 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:57.272259 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0c9e5f09-e84c-4d4e-b437-94d392f88546 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:57.351004 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2a2adadf-8823-4f63-8e0a-ba9bdc3cd47f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:57.351712 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-2a2adadf-8823-4f63-8e0a-ba9bdc3cd47f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:57.357906 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2a2adadf-8823-4f63-8e0a-ba9bdc3cd47f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:57.358362 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2a2adadf-8823-4f63-8e0a-ba9bdc3cd47f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:57.359203 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2a2adadf-8823-4f63-8e0a-ba9bdc3cd47f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:57.359575 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2a2adadf-8823-4f63-8e0a-ba9bdc3cd47f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:57.500118 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-2a2adadf-8823-4f63-8e0a-ba9bdc3cd47f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:57.500760 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-0c9e5f09-e84c-4d4e-b437-94d392f88546 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:57.509496 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-2a2adadf-8823-4f63-8e0a-ba9bdc3cd47f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1723 microversion: 2.1 time: 0.162969 Nov 21 13:53:57.511923 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-0c9e5f09-e84c-4d4e-b437-94d392f88546 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1509 microversion: 2.1 time: 0.252447 Nov 21 13:53:57.512664 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 175/358] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:57 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1509 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:53:57.519926 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 184/359] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:57 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:53:57.887346 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-7870a015-730b-4eec-b4a7-de10c4b9d4c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:57.887902 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-7870a015-730b-4eec-b4a7-de10c4b9d4c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:57.894250 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7870a015-730b-4eec-b4a7-de10c4b9d4c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:57.894717 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7870a015-730b-4eec-b4a7-de10c4b9d4c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:57.895498 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7870a015-730b-4eec-b4a7-de10c4b9d4c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:57.895950 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7870a015-730b-4eec-b4a7-de10c4b9d4c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:58.032304 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-7870a015-730b-4eec-b4a7-de10c4b9d4c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:58.040607 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-7870a015-730b-4eec-b4a7-de10c4b9d4c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:58.042113 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-7870a015-730b-4eec-b4a7-de10c4b9d4c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:58.043349 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-7870a015-730b-4eec-b4a7-de10c4b9d4c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.159665 Nov 21 13:53:58.043948 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 176/360] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:53:57 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:53:58.526240 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-1e170e9b-4ee3-4e30-a601-ac7d3c236db6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:58.526848 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-1e170e9b-4ee3-4e30-a601-ac7d3c236db6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:58.529161 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-585e3585-5203-4da9-9d25-612e866447aa tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:58.530059 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-585e3585-5203-4da9-9d25-612e866447aa tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:58.533637 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1e170e9b-4ee3-4e30-a601-ac7d3c236db6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:58.534258 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1e170e9b-4ee3-4e30-a601-ac7d3c236db6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:58.535594 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1e170e9b-4ee3-4e30-a601-ac7d3c236db6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:58.536054 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1e170e9b-4ee3-4e30-a601-ac7d3c236db6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:58.537127 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-585e3585-5203-4da9-9d25-612e866447aa tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:58.540684 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-585e3585-5203-4da9-9d25-612e866447aa tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:58.541575 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-585e3585-5203-4da9-9d25-612e866447aa tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:58.542246 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-585e3585-5203-4da9-9d25-612e866447aa tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:58.726134 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-585e3585-5203-4da9-9d25-612e866447aa tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:58.733628 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-585e3585-5203-4da9-9d25-612e866447aa tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1509 microversion: 2.1 time: 0.207989 Nov 21 13:53:58.734191 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 177/361] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:58 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1509 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:53:58.748073 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-918610067", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1260128638", "security_groups": [{"name": "tempest-secgroup-smoke-1708594432"}], "networks": [{"uuid": "0f3bd10b-114c-4dbf-afd6-006b9d81d12f"}], "block_device_mapping_v2": [{"uuid": "2b24070d-0ae2-467e-bb7f-83aa771e91c8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:53:58.839631 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-1e170e9b-4ee3-4e30-a601-ac7d3c236db6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:58.850151 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-1e170e9b-4ee3-4e30-a601-ac7d3c236db6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1723 microversion: 2.1 time: 0.327351 Nov 21 13:53:58.850930 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 185/362] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:58 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1723 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:58.904961 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.network.neutron [None req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] validate_networks() for [('0f3bd10b-114c-4dbf-afd6-006b9d81d12f', None, None, None, None, None)] {{(pid=122565) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 21 13:53:59.064010 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-c1041e77-518b-4a87-b61f-c9e9dfb96fb8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:59.064717 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-c1041e77-518b-4a87-b61f-c9e9dfb96fb8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:59.070631 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c1041e77-518b-4a87-b61f-c9e9dfb96fb8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:59.071254 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c1041e77-518b-4a87-b61f-c9e9dfb96fb8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:59.072153 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c1041e77-518b-4a87-b61f-c9e9dfb96fb8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:59.072655 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c1041e77-518b-4a87-b61f-c9e9dfb96fb8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:59.219186 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-c1041e77-518b-4a87-b61f-c9e9dfb96fb8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:59.228011 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-c1041e77-518b-4a87-b61f-c9e9dfb96fb8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:59.229533 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-c1041e77-518b-4a87-b61f-c9e9dfb96fb8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:59.230682 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-c1041e77-518b-4a87-b61f-c9e9dfb96fb8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.170624 Nov 21 13:53:59.234301 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 186/363] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:53:59 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 13:53:59.318363 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Flavor limits 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 13:53:59.318790 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Image limits 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 13:53:59.319269 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Flavor pref 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 13:53:59.319678 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Image pref 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 13:53:59.320118 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 13:53:59.328631 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:59.329080 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:59.329895 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:59.330330 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:59.347793 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Getting quotas for project 3f91d0ec3fb5421aa1fb95a0cb0d040d. Resources: {'instances', 'ram', 'cores'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:53:59.352053 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Getting quotas for user 11c7290106424ae8bc4ddf72844fc3a8 and project 3f91d0ec3fb5421aa1fb95a0cb0d040d. Resources: {'instances', 'ram', 'cores'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:53:59.408109 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Going to run 1 instances... {{(pid=122565) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 13:53:59.410290 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b24070d-0ae2-467e-bb7f-83aa771e91c8',volume_size=None,volume_type=None)] {{(pid=122565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 13:53:59.554853 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.810367 Nov 21 13:53:59.555671 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 178/364] 10.222.0.11 () {60 vars in 1146 bytes} [Sun Nov 21 13:53:58 2021] POST /compute/v2.1/servers => generated 406 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 13:53:59.566739 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-eb0b90d1-6172-4f94-bd21-b5eeac823ea8 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:59.567752 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-eb0b90d1-6172-4f94-bd21-b5eeac823ea8 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:59.625983 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-eb0b90d1-6172-4f94-bd21-b5eeac823ea8 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:59.635375 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-eb0b90d1-6172-4f94-bd21-b5eeac823ea8 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1088 microversion: 2.1 time: 0.073828 Nov 21 13:53:59.645185 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 187/365] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:59 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:53:59.750383 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-19744f82-3b6e-4a9c-aed0-69e71ee9facb tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:59.751868 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-19744f82-3b6e-4a9c-aed0-69e71ee9facb tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:59.768841 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-19744f82-3b6e-4a9c-aed0-69e71ee9facb tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:59.769955 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-19744f82-3b6e-4a9c-aed0-69e71ee9facb tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:59.770831 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-19744f82-3b6e-4a9c-aed0-69e71ee9facb tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:59.771277 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-19744f82-3b6e-4a9c-aed0-69e71ee9facb tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:59.869203 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-8c0563ea-3bf8-421c-ae94-944b2ea3d851 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:53:59.870406 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-8c0563ea-3bf8-421c-ae94-944b2ea3d851 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:53:59.878180 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8c0563ea-3bf8-421c-ae94-944b2ea3d851 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:59.878872 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8c0563ea-3bf8-421c-ae94-944b2ea3d851 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:59.880227 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8c0563ea-3bf8-421c-ae94-944b2ea3d851 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:53:59.880993 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8c0563ea-3bf8-421c-ae94-944b2ea3d851 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:53:59.963660 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-19744f82-3b6e-4a9c-aed0-69e71ee9facb tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:53:59.978276 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-19744f82-3b6e-4a9c-aed0-69e71ee9facb tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1515 microversion: 2.1 time: 0.231446 Nov 21 13:53:59.985216 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 179/366] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:59 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1515 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:00.066742 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-8c0563ea-3bf8-421c-ae94-944b2ea3d851 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:00.075253 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-8c0563ea-3bf8-421c-ae94-944b2ea3d851 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1723 microversion: 2.1 time: 0.210179 Nov 21 13:54:00.076434 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 188/367] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:53:59 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:00.250434 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-f2586bdc-061e-4ff3-a2b6-44c3c457aa65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:00.251848 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-f2586bdc-061e-4ff3-a2b6-44c3c457aa65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:00.263855 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f2586bdc-061e-4ff3-a2b6-44c3c457aa65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:00.264428 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f2586bdc-061e-4ff3-a2b6-44c3c457aa65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:00.267702 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f2586bdc-061e-4ff3-a2b6-44c3c457aa65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:00.268299 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f2586bdc-061e-4ff3-a2b6-44c3c457aa65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:00.458509 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-f2586bdc-061e-4ff3-a2b6-44c3c457aa65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:00.466490 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-f2586bdc-061e-4ff3-a2b6-44c3c457aa65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:00.467966 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-f2586bdc-061e-4ff3-a2b6-44c3c457aa65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:00.469276 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-f2586bdc-061e-4ff3-a2b6-44c3c457aa65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.223485 Nov 21 13:54:00.469823 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 180/368] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:00 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:00.651663 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-e2432a28-1de9-4dc8-bafa-f984bf933ca9 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:00.652445 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-e2432a28-1de9-4dc8-bafa-f984bf933ca9 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:00.658593 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e2432a28-1de9-4dc8-bafa-f984bf933ca9 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:00.659169 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e2432a28-1de9-4dc8-bafa-f984bf933ca9 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:00.660339 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e2432a28-1de9-4dc8-bafa-f984bf933ca9 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:00.661041 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e2432a28-1de9-4dc8-bafa-f984bf933ca9 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:00.723234 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-e2432a28-1de9-4dc8-bafa-f984bf933ca9 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:00.731876 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-e2432a28-1de9-4dc8-bafa-f984bf933ca9 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1186 microversion: 2.1 time: 0.083754 Nov 21 13:54:00.732451 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 189/369] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:00 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1186 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:01.094452 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-b07417fa-01ca-4085-b495-1ece45af6983 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:01.095438 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-b07417fa-01ca-4085-b495-1ece45af6983 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:01.103390 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b07417fa-01ca-4085-b495-1ece45af6983 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:01.103909 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b07417fa-01ca-4085-b495-1ece45af6983 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:01.104702 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b07417fa-01ca-4085-b495-1ece45af6983 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:01.105170 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b07417fa-01ca-4085-b495-1ece45af6983 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:01.349218 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-b07417fa-01ca-4085-b495-1ece45af6983 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:01.370119 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-b07417fa-01ca-4085-b495-1ece45af6983 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1723 microversion: 2.1 time: 0.280205 Nov 21 13:54:01.371217 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 181/370] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:01 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:01.371390 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-202da340-5a2f-47a1-92f5-10fa85f91fb5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:01.372196 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-202da340-5a2f-47a1-92f5-10fa85f91fb5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:01.383094 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-202da340-5a2f-47a1-92f5-10fa85f91fb5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:01.383667 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-202da340-5a2f-47a1-92f5-10fa85f91fb5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:01.384523 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-202da340-5a2f-47a1-92f5-10fa85f91fb5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:01.384961 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-202da340-5a2f-47a1-92f5-10fa85f91fb5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:01.493880 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-7fb0f1ad-99d8-4809-af6a-c4ccf7734273 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:01.496150 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-7fb0f1ad-99d8-4809-af6a-c4ccf7734273 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:01.503038 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7fb0f1ad-99d8-4809-af6a-c4ccf7734273 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:01.503731 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7fb0f1ad-99d8-4809-af6a-c4ccf7734273 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:01.504722 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7fb0f1ad-99d8-4809-af6a-c4ccf7734273 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:01.505331 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7fb0f1ad-99d8-4809-af6a-c4ccf7734273 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:01.555403 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-202da340-5a2f-47a1-92f5-10fa85f91fb5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:01.566898 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-202da340-5a2f-47a1-92f5-10fa85f91fb5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1515 microversion: 2.1 time: 0.198448 Nov 21 13:54:01.567665 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 190/371] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:01 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1515 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:01.588088 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-dc55402d-c3e7-46cc-a31a-569013816c9b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0f4d794-6871-48ad-9751-4c165027171b"}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:54:01.589716 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-dc55402d-c3e7-46cc-a31a-569013816c9b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:01.598751 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-dc55402d-c3e7-46cc-a31a-569013816c9b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:01.599203 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-dc55402d-c3e7-46cc-a31a-569013816c9b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:01.600092 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-dc55402d-c3e7-46cc-a31a-569013816c9b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:01.600526 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-dc55402d-c3e7-46cc-a31a-569013816c9b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:01.899583 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-dc55402d-c3e7-46cc-a31a-569013816c9b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "POST /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318299 Nov 21 13:54:01.900254 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 191/372] 10.222.0.11 () {60 vars in 1322 bytes} [Sun Nov 21 13:54:01 2021] POST /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:54:01.906222 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-8a7449ea-9f92-44d1-a512-cddfc9569a2c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:01.907355 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-8a7449ea-9f92-44d1-a512-cddfc9569a2c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:01.924688 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8a7449ea-9f92-44d1-a512-cddfc9569a2c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:01.925274 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8a7449ea-9f92-44d1-a512-cddfc9569a2c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:01.926948 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8a7449ea-9f92-44d1-a512-cddfc9569a2c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:01.927692 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8a7449ea-9f92-44d1-a512-cddfc9569a2c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:02.018832 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-7fb0f1ad-99d8-4809-af6a-c4ccf7734273 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:02.028454 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-7fb0f1ad-99d8-4809-af6a-c4ccf7734273 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:02.031886 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-7fb0f1ad-99d8-4809-af6a-c4ccf7734273 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:02.044301 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-7fb0f1ad-99d8-4809-af6a-c4ccf7734273 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.558854 Nov 21 13:54:02.046289 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 182/373] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:01 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 13:54:02.099293 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-8a7449ea-9f92-44d1-a512-cddfc9569a2c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:02.107353 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-8a7449ea-9f92-44d1-a512-cddfc9569a2c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1260 microversion: 2.1 time: 0.205520 Nov 21 13:54:02.116887 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 192/374] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:01 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:02.391151 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-6c665d0c-245f-4a70-9265-09404e48d08b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:02.391829 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-6c665d0c-245f-4a70-9265-09404e48d08b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:02.401739 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6c665d0c-245f-4a70-9265-09404e48d08b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:02.402254 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6c665d0c-245f-4a70-9265-09404e48d08b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:02.403068 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6c665d0c-245f-4a70-9265-09404e48d08b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:02.403508 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6c665d0c-245f-4a70-9265-09404e48d08b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:02.611615 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-6c665d0c-245f-4a70-9265-09404e48d08b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:02.620397 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-6c665d0c-245f-4a70-9265-09404e48d08b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1723 microversion: 2.1 time: 0.235853 Nov 21 13:54:02.621055 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 183/375] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:02 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:02.683586 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-a173755a-61c4-4384-b7b2-0daa92055abc req-ac6eb361-d6fb-4fd4-9338-f92224dbe86e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2707c966-28e3-43ba-9241-d5629ba92b06", "tag": "5907d47d-9ae0-44a4-adf8-9e5e784f851a"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:54:02.688777 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:54:02.688777 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:54:02.711591 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-a173755a-61c4-4384-b7b2-0daa92055abc req-ac6eb361-d6fb-4fd4-9338-f92224dbe86e service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:02.712088 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-a173755a-61c4-4384-b7b2-0daa92055abc req-ac6eb361-d6fb-4fd4-9338-f92224dbe86e service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:02.723699 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-a173755a-61c4-4384-b7b2-0daa92055abc req-ac6eb361-d6fb-4fd4-9338-f92224dbe86e service nova] Creating event network-changed:5907d47d-9ae0-44a4-adf8-9e5e784f851a for instance 2707c966-28e3-43ba-9241-d5629ba92b06 on hv-cinder-76845 Nov 21 13:54:02.728712 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-a173755a-61c4-4384-b7b2-0daa92055abc req-ac6eb361-d6fb-4fd4-9338-f92224dbe86e service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048769 Nov 21 13:54:02.729549 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 193/376] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:54:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:54:03.065997 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-0e637f81-2f03-4ed0-8052-2bd990f4b7ab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:03.066509 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-0e637f81-2f03-4ed0-8052-2bd990f4b7ab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:03.072421 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0e637f81-2f03-4ed0-8052-2bd990f4b7ab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:03.072875 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0e637f81-2f03-4ed0-8052-2bd990f4b7ab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:03.073657 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0e637f81-2f03-4ed0-8052-2bd990f4b7ab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:03.074091 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0e637f81-2f03-4ed0-8052-2bd990f4b7ab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:03.135187 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-a6811b02-f7de-4b5e-8989-61a7319ff104 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:03.136034 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-a6811b02-f7de-4b5e-8989-61a7319ff104 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:03.142308 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a6811b02-f7de-4b5e-8989-61a7319ff104 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:03.142846 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a6811b02-f7de-4b5e-8989-61a7319ff104 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:03.143740 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a6811b02-f7de-4b5e-8989-61a7319ff104 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:03.144835 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a6811b02-f7de-4b5e-8989-61a7319ff104 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:03.244295 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-0e637f81-2f03-4ed0-8052-2bd990f4b7ab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:03.253610 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-0e637f81-2f03-4ed0-8052-2bd990f4b7ab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:03.255103 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-0e637f81-2f03-4ed0-8052-2bd990f4b7ab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:03.256327 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-0e637f81-2f03-4ed0-8052-2bd990f4b7ab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.195686 Nov 21 13:54:03.256878 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 184/377] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:03 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:03.291507 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-a6811b02-f7de-4b5e-8989-61a7319ff104 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:03.298556 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-a6811b02-f7de-4b5e-8989-61a7319ff104 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1260 microversion: 2.1 time: 0.168329 Nov 21 13:54:03.299121 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 194/378] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:03 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:03.638205 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-bb663853-ac8d-4096-9c6c-c138b8c2d927 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:03.638822 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-bb663853-ac8d-4096-9c6c-c138b8c2d927 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:03.645223 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bb663853-ac8d-4096-9c6c-c138b8c2d927 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:03.645679 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bb663853-ac8d-4096-9c6c-c138b8c2d927 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:03.646465 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bb663853-ac8d-4096-9c6c-c138b8c2d927 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:03.646910 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bb663853-ac8d-4096-9c6c-c138b8c2d927 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:03.820985 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bb663853-ac8d-4096-9c6c-c138b8c2d927 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:03.829225 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-bb663853-ac8d-4096-9c6c-c138b8c2d927 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1723 microversion: 2.1 time: 0.194679 Nov 21 13:54:03.829794 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 185/379] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:03 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:04.274332 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-e3c48d02-1381-4a6d-b49c-24bc8996cd83 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:04.274944 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-e3c48d02-1381-4a6d-b49c-24bc8996cd83 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:04.281323 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e3c48d02-1381-4a6d-b49c-24bc8996cd83 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:04.281718 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e3c48d02-1381-4a6d-b49c-24bc8996cd83 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:04.282494 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e3c48d02-1381-4a6d-b49c-24bc8996cd83 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:04.282926 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e3c48d02-1381-4a6d-b49c-24bc8996cd83 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:04.317865 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-f9234bbb-14a9-4a5e-b694-5162d6d180c7 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:04.318835 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-f9234bbb-14a9-4a5e-b694-5162d6d180c7 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:04.325147 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f9234bbb-14a9-4a5e-b694-5162d6d180c7 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:04.325605 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f9234bbb-14a9-4a5e-b694-5162d6d180c7 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:04.326408 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f9234bbb-14a9-4a5e-b694-5162d6d180c7 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:04.326852 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f9234bbb-14a9-4a5e-b694-5162d6d180c7 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:04.428158 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-e3c48d02-1381-4a6d-b49c-24bc8996cd83 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:04.436478 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-e3c48d02-1381-4a6d-b49c-24bc8996cd83 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:04.437981 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-e3c48d02-1381-4a6d-b49c-24bc8996cd83 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:04.439147 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-e3c48d02-1381-4a6d-b49c-24bc8996cd83 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.168538 Nov 21 13:54:04.439718 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 195/380] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:04 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:04.466215 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-f9234bbb-14a9-4a5e-b694-5162d6d180c7 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:04.474107 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-f9234bbb-14a9-4a5e-b694-5162d6d180c7 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1260 microversion: 2.1 time: 0.161871 Nov 21 13:54:04.474667 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 186/381] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:04 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:04.846521 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-dc67033e-1275-45c7-b972-8f167831d937 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:04.847049 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-dc67033e-1275-45c7-b972-8f167831d937 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:04.853783 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-dc67033e-1275-45c7-b972-8f167831d937 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:04.854232 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-dc67033e-1275-45c7-b972-8f167831d937 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:04.855030 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-dc67033e-1275-45c7-b972-8f167831d937 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:04.855462 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-dc67033e-1275-45c7-b972-8f167831d937 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:04.990399 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-dc67033e-1275-45c7-b972-8f167831d937 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:04.998265 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-dc67033e-1275-45c7-b972-8f167831d937 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1723 microversion: 2.1 time: 0.155494 Nov 21 13:54:04.998838 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 196/382] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:04 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:05.458279 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-48e78649-6a66-421d-965b-12f5331f00f6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:05.458784 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-48e78649-6a66-421d-965b-12f5331f00f6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:05.465132 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-48e78649-6a66-421d-965b-12f5331f00f6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:05.465583 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-48e78649-6a66-421d-965b-12f5331f00f6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:05.466359 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-48e78649-6a66-421d-965b-12f5331f00f6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:05.466794 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-48e78649-6a66-421d-965b-12f5331f00f6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:05.491432 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-154af5a0-01f7-4ea5-826c-e4af487490ee tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:05.492349 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-154af5a0-01f7-4ea5-826c-e4af487490ee tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:05.500160 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-154af5a0-01f7-4ea5-826c-e4af487490ee tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:05.500593 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-154af5a0-01f7-4ea5-826c-e4af487490ee tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:05.501678 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-154af5a0-01f7-4ea5-826c-e4af487490ee tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:05.502110 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-154af5a0-01f7-4ea5-826c-e4af487490ee tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:05.605825 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-48e78649-6a66-421d-965b-12f5331f00f6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:05.614473 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-48e78649-6a66-421d-965b-12f5331f00f6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:05.616255 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-48e78649-6a66-421d-965b-12f5331f00f6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:05.617979 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-48e78649-6a66-421d-965b-12f5331f00f6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.163909 Nov 21 13:54:05.619796 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 187/383] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:05 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:05.639367 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-154af5a0-01f7-4ea5-826c-e4af487490ee tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:05.646743 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-154af5a0-01f7-4ea5-826c-e4af487490ee tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1260 microversion: 2.1 time: 0.159930 Nov 21 13:54:05.647381 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 197/384] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:05 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:06.016508 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-db941cec-1d79-4497-9fde-32f9d31b405a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:06.017125 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-db941cec-1d79-4497-9fde-32f9d31b405a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:06.023168 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-db941cec-1d79-4497-9fde-32f9d31b405a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:06.023617 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-db941cec-1d79-4497-9fde-32f9d31b405a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:06.024441 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-db941cec-1d79-4497-9fde-32f9d31b405a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:06.024883 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-db941cec-1d79-4497-9fde-32f9d31b405a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:06.156347 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-db941cec-1d79-4497-9fde-32f9d31b405a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:06.164665 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-db941cec-1d79-4497-9fde-32f9d31b405a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1723 microversion: 2.1 time: 0.151951 Nov 21 13:54:06.175461 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 188/385] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:06 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:06.636166 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-df3d76cb-3f90-4b27-9680-9db255c1f72c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:06.636775 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-df3d76cb-3f90-4b27-9680-9db255c1f72c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:06.643055 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-df3d76cb-3f90-4b27-9680-9db255c1f72c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:06.643506 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-df3d76cb-3f90-4b27-9680-9db255c1f72c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:06.644323 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-df3d76cb-3f90-4b27-9680-9db255c1f72c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:06.644757 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-df3d76cb-3f90-4b27-9680-9db255c1f72c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:06.664781 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-6e6000ba-79f2-4447-b16a-add9027e3cf3 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:06.665147 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-6e6000ba-79f2-4447-b16a-add9027e3cf3 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:06.671558 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6e6000ba-79f2-4447-b16a-add9027e3cf3 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:06.672116 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6e6000ba-79f2-4447-b16a-add9027e3cf3 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:06.672975 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6e6000ba-79f2-4447-b16a-add9027e3cf3 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:06.673487 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6e6000ba-79f2-4447-b16a-add9027e3cf3 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:06.799696 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-df3d76cb-3f90-4b27-9680-9db255c1f72c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:06.810555 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-df3d76cb-3f90-4b27-9680-9db255c1f72c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:06.812083 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-df3d76cb-3f90-4b27-9680-9db255c1f72c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:06.813672 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-df3d76cb-3f90-4b27-9680-9db255c1f72c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.181042 Nov 21 13:54:06.814229 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 198/386] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:06 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:06.829302 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-6e6000ba-79f2-4447-b16a-add9027e3cf3 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:06.837591 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-6e6000ba-79f2-4447-b16a-add9027e3cf3 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1260 microversion: 2.1 time: 0.177700 Nov 21 13:54:06.838338 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 189/387] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:06 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:07.182254 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-71f2e123-c649-4217-8e8e-ff30ea437b3c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:07.182977 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-71f2e123-c649-4217-8e8e-ff30ea437b3c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:07.189272 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-71f2e123-c649-4217-8e8e-ff30ea437b3c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:07.189519 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-71f2e123-c649-4217-8e8e-ff30ea437b3c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:07.190226 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-71f2e123-c649-4217-8e8e-ff30ea437b3c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:07.190654 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-71f2e123-c649-4217-8e8e-ff30ea437b3c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:07.328867 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-71f2e123-c649-4217-8e8e-ff30ea437b3c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:07.336622 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-71f2e123-c649-4217-8e8e-ff30ea437b3c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1723 microversion: 2.1 time: 0.158104 Nov 21 13:54:07.337185 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 199/388] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:07 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:07.831950 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-4a84dba1-2694-483c-826c-2d35ccbbdf80 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:07.832615 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-4a84dba1-2694-483c-826c-2d35ccbbdf80 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:07.839141 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4a84dba1-2694-483c-826c-2d35ccbbdf80 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:07.839606 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4a84dba1-2694-483c-826c-2d35ccbbdf80 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:07.840420 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4a84dba1-2694-483c-826c-2d35ccbbdf80 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:07.840859 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4a84dba1-2694-483c-826c-2d35ccbbdf80 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:07.854636 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-661c5062-f1a2-4a61-9d22-5ef51cd0fa31 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:07.855248 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-661c5062-f1a2-4a61-9d22-5ef51cd0fa31 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:07.861387 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-661c5062-f1a2-4a61-9d22-5ef51cd0fa31 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:07.861895 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-661c5062-f1a2-4a61-9d22-5ef51cd0fa31 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:07.862682 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-661c5062-f1a2-4a61-9d22-5ef51cd0fa31 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:07.863121 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-661c5062-f1a2-4a61-9d22-5ef51cd0fa31 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:07.985309 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4a84dba1-2694-483c-826c-2d35ccbbdf80 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:07.993077 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4a84dba1-2694-483c-826c-2d35ccbbdf80 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:07.994849 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4a84dba1-2694-483c-826c-2d35ccbbdf80 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:07.996047 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-4a84dba1-2694-483c-826c-2d35ccbbdf80 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.168282 Nov 21 13:54:07.996608 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 190/389] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:07 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:08.006757 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-661c5062-f1a2-4a61-9d22-5ef51cd0fa31 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:08.013959 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-661c5062-f1a2-4a61-9d22-5ef51cd0fa31 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1260 microversion: 2.1 time: 0.162925 Nov 21 13:54:08.014490 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 200/390] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:07 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:08.353364 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-d10da17d-5f22-4646-9bb8-c23e99c0a3eb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:08.354014 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-d10da17d-5f22-4646-9bb8-c23e99c0a3eb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:08.360769 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d10da17d-5f22-4646-9bb8-c23e99c0a3eb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:08.361239 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d10da17d-5f22-4646-9bb8-c23e99c0a3eb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:08.362126 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d10da17d-5f22-4646-9bb8-c23e99c0a3eb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:08.362572 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d10da17d-5f22-4646-9bb8-c23e99c0a3eb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:08.494781 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-d10da17d-5f22-4646-9bb8-c23e99c0a3eb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:08.503038 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-d10da17d-5f22-4646-9bb8-c23e99c0a3eb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1723 microversion: 2.1 time: 0.153495 Nov 21 13:54:08.503604 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 191/391] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:08 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:09.014234 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-49aa1ec4-1999-4237-8c9a-bd69235124f4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:09.014830 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-49aa1ec4-1999-4237-8c9a-bd69235124f4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:09.021736 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-49aa1ec4-1999-4237-8c9a-bd69235124f4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:09.022125 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-49aa1ec4-1999-4237-8c9a-bd69235124f4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:09.022905 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-49aa1ec4-1999-4237-8c9a-bd69235124f4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:09.023345 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-49aa1ec4-1999-4237-8c9a-bd69235124f4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:09.031178 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-0bbb37c6-8dbb-4b67-b3b0-ae1e21d56cb0 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:09.031794 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-0bbb37c6-8dbb-4b67-b3b0-ae1e21d56cb0 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:09.039349 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0bbb37c6-8dbb-4b67-b3b0-ae1e21d56cb0 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:09.039864 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0bbb37c6-8dbb-4b67-b3b0-ae1e21d56cb0 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:09.040674 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0bbb37c6-8dbb-4b67-b3b0-ae1e21d56cb0 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:09.041114 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0bbb37c6-8dbb-4b67-b3b0-ae1e21d56cb0 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:09.157005 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-49aa1ec4-1999-4237-8c9a-bd69235124f4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:09.165606 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-49aa1ec4-1999-4237-8c9a-bd69235124f4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:09.167394 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-49aa1ec4-1999-4237-8c9a-bd69235124f4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:09.168765 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-49aa1ec4-1999-4237-8c9a-bd69235124f4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.158106 Nov 21 13:54:09.179663 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 201/392] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:09 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:09.180069 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-0bbb37c6-8dbb-4b67-b3b0-ae1e21d56cb0 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:09.184481 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-0bbb37c6-8dbb-4b67-b3b0-ae1e21d56cb0 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1260 microversion: 2.1 time: 0.157325 Nov 21 13:54:09.185034 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 192/393] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:09 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:09.396566 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-5d4fabf0-86e7-4dff-9ebb-5060612eae74 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:54:09.398172 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-5d4fabf0-86e7-4dff-9ebb-5060612eae74 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:09.403952 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5d4fabf0-86e7-4dff-9ebb-5060612eae74 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:09.404472 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5d4fabf0-86e7-4dff-9ebb-5060612eae74 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:09.405315 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5d4fabf0-86e7-4dff-9ebb-5060612eae74 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:09.405816 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5d4fabf0-86e7-4dff-9ebb-5060612eae74 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:09.427245 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.objects.instance [None req-5d4fabf0-86e7-4dff-9ebb-5060612eae74 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lazy-loading 'flavor' on Instance uuid 2d1c9d3d-f088-4d2f-b2bc-e26543509aae {{(pid=122564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:54:09.522144 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c8cface9-ac37-4e03-b3cf-13f20cdf9ed2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:09.523042 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-c8cface9-ac37-4e03-b3cf-13f20cdf9ed2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:09.529495 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c8cface9-ac37-4e03-b3cf-13f20cdf9ed2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:09.530074 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c8cface9-ac37-4e03-b3cf-13f20cdf9ed2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:09.530868 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c8cface9-ac37-4e03-b3cf-13f20cdf9ed2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:09.531311 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c8cface9-ac37-4e03-b3cf-13f20cdf9ed2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:09.543632 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-5d4fabf0-86e7-4dff-9ebb-5060612eae74 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "POST /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae/action" status: 200 len: 32 microversion: 2.1 time: 0.152253 Nov 21 13:54:09.544520 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 202/394] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:54:09 2021] POST /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae/action => generated 32 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:54:09.554633 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ab1525e4-ca78-416d-b61e-b18b16ef4b87 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:09.555349 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ab1525e4-ca78-416d-b61e-b18b16ef4b87 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:09.561719 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ab1525e4-ca78-416d-b61e-b18b16ef4b87 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:09.562185 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ab1525e4-ca78-416d-b61e-b18b16ef4b87 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:09.563174 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ab1525e4-ca78-416d-b61e-b18b16ef4b87 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:09.563478 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ab1525e4-ca78-416d-b61e-b18b16ef4b87 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:09.709323 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-ab1525e4-ca78-416d-b61e-b18b16ef4b87 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:09.717132 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ab1525e4-ca78-416d-b61e-b18b16ef4b87 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.167173 Nov 21 13:54:09.717704 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 203/395] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:09 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:09.745226 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-c8cface9-ac37-4e03-b3cf-13f20cdf9ed2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:09.753282 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c8cface9-ac37-4e03-b3cf-13f20cdf9ed2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1723 microversion: 2.1 time: 0.234870 Nov 21 13:54:09.753843 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 193/396] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:09 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:10.186195 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-db75d8ff-d31e-48d6-8391-7768278a6153 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:10.186807 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-db75d8ff-d31e-48d6-8391-7768278a6153 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:10.193075 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-db75d8ff-d31e-48d6-8391-7768278a6153 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:10.193525 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-db75d8ff-d31e-48d6-8391-7768278a6153 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:10.194302 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-db75d8ff-d31e-48d6-8391-7768278a6153 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:10.194737 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-db75d8ff-d31e-48d6-8391-7768278a6153 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:10.201370 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c5ce36a9-8eb9-495d-abae-32e012d2738b tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:10.201970 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-c5ce36a9-8eb9-495d-abae-32e012d2738b tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:10.208407 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c5ce36a9-8eb9-495d-abae-32e012d2738b tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:10.208857 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c5ce36a9-8eb9-495d-abae-32e012d2738b tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:10.209627 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c5ce36a9-8eb9-495d-abae-32e012d2738b tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:10.210058 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c5ce36a9-8eb9-495d-abae-32e012d2738b tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:10.334645 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-db75d8ff-d31e-48d6-8391-7768278a6153 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:10.342494 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-db75d8ff-d31e-48d6-8391-7768278a6153 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:10.344032 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-db75d8ff-d31e-48d6-8391-7768278a6153 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:10.345190 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-db75d8ff-d31e-48d6-8391-7768278a6153 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.162648 Nov 21 13:54:10.345752 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 204/397] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:10 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:10.350221 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-c5ce36a9-8eb9-495d-abae-32e012d2738b tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:10.357588 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c5ce36a9-8eb9-495d-abae-32e012d2738b tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1260 microversion: 2.1 time: 0.159840 Nov 21 13:54:10.358157 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 194/398] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:10 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:10.734355 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-a167ae1a-a7a5-4969-a4f9-cefc5c0aaf2a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:10.734887 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-a167ae1a-a7a5-4969-a4f9-cefc5c0aaf2a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:10.741499 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a167ae1a-a7a5-4969-a4f9-cefc5c0aaf2a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:10.741985 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a167ae1a-a7a5-4969-a4f9-cefc5c0aaf2a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:10.742765 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a167ae1a-a7a5-4969-a4f9-cefc5c0aaf2a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:10.743204 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a167ae1a-a7a5-4969-a4f9-cefc5c0aaf2a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:10.770261 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-b30f3e34-879e-4b23-a1ba-977d07b833b2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:10.770901 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-b30f3e34-879e-4b23-a1ba-977d07b833b2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:10.776723 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b30f3e34-879e-4b23-a1ba-977d07b833b2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:10.777172 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b30f3e34-879e-4b23-a1ba-977d07b833b2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:10.777952 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b30f3e34-879e-4b23-a1ba-977d07b833b2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:10.778387 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b30f3e34-879e-4b23-a1ba-977d07b833b2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:10.878169 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-a167ae1a-a7a5-4969-a4f9-cefc5c0aaf2a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:10.886589 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-a167ae1a-a7a5-4969-a4f9-cefc5c0aaf2a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.155942 Nov 21 13:54:10.887532 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 205/399] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:10 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:10.909904 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-b30f3e34-879e-4b23-a1ba-977d07b833b2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:10.918081 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-b30f3e34-879e-4b23-a1ba-977d07b833b2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1723 microversion: 2.1 time: 0.151619 Nov 21 13:54:10.918638 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 195/400] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:10 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:11.363062 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b0044423-2930-4f80-888f-041a1087b04b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:11.363665 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b0044423-2930-4f80-888f-041a1087b04b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:11.369905 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b0044423-2930-4f80-888f-041a1087b04b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:11.370352 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b0044423-2930-4f80-888f-041a1087b04b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:11.371118 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b0044423-2930-4f80-888f-041a1087b04b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:11.371547 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b0044423-2930-4f80-888f-041a1087b04b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:11.379710 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-f07fed6d-1d7e-4b30-90c1-3c5544b1b737 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:11.380350 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-f07fed6d-1d7e-4b30-90c1-3c5544b1b737 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:11.387024 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f07fed6d-1d7e-4b30-90c1-3c5544b1b737 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:11.387532 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f07fed6d-1d7e-4b30-90c1-3c5544b1b737 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:11.390726 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f07fed6d-1d7e-4b30-90c1-3c5544b1b737 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:11.390726 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f07fed6d-1d7e-4b30-90c1-3c5544b1b737 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:11.519018 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-b0044423-2930-4f80-888f-041a1087b04b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:11.527172 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-b0044423-2930-4f80-888f-041a1087b04b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:11.528678 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-b0044423-2930-4f80-888f-041a1087b04b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:11.529848 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-b0044423-2930-4f80-888f-041a1087b04b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.170459 Nov 21 13:54:11.530403 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 206/401] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:11 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:11.535097 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-f07fed6d-1d7e-4b30-90c1-3c5544b1b737 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:11.542555 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-f07fed6d-1d7e-4b30-90c1-3c5544b1b737 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1260 microversion: 2.1 time: 0.166735 Nov 21 13:54:11.543053 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 196/402] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:11 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:11.903863 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-92e91efc-e286-4d42-a593-f6c7ae1d7211 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:11.904256 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-92e91efc-e286-4d42-a593-f6c7ae1d7211 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:11.910452 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-92e91efc-e286-4d42-a593-f6c7ae1d7211 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:11.910911 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-92e91efc-e286-4d42-a593-f6c7ae1d7211 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:11.911697 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-92e91efc-e286-4d42-a593-f6c7ae1d7211 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:11.912153 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-92e91efc-e286-4d42-a593-f6c7ae1d7211 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:11.936261 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-fcc06aac-cb82-472a-8e94-c98867cd6b04 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:11.936743 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-fcc06aac-cb82-472a-8e94-c98867cd6b04 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:11.943978 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fcc06aac-cb82-472a-8e94-c98867cd6b04 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:11.944756 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fcc06aac-cb82-472a-8e94-c98867cd6b04 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:11.945888 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fcc06aac-cb82-472a-8e94-c98867cd6b04 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:11.946474 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fcc06aac-cb82-472a-8e94-c98867cd6b04 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:12.068621 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-92e91efc-e286-4d42-a593-f6c7ae1d7211 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:12.076622 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-92e91efc-e286-4d42-a593-f6c7ae1d7211 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.176644 Nov 21 13:54:12.077201 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 207/403] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:11 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:12.085441 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-fcc06aac-cb82-472a-8e94-c98867cd6b04 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:12.093238 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-fcc06aac-cb82-472a-8e94-c98867cd6b04 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1723 microversion: 2.1 time: 0.160664 Nov 21 13:54:12.093796 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 197/404] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:11 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:12.548040 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-09eabf8d-91c5-4960-bc3a-e6740c4cea10 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:12.548653 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-09eabf8d-91c5-4960-bc3a-e6740c4cea10 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:12.555371 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-09eabf8d-91c5-4960-bc3a-e6740c4cea10 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:12.555846 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-09eabf8d-91c5-4960-bc3a-e6740c4cea10 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:12.556639 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-09eabf8d-91c5-4960-bc3a-e6740c4cea10 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:12.557072 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-09eabf8d-91c5-4960-bc3a-e6740c4cea10 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:12.558405 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-f86f8551-fde2-48e8-a2df-eed165bdd3a9 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:12.559023 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-f86f8551-fde2-48e8-a2df-eed165bdd3a9 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:12.565316 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f86f8551-fde2-48e8-a2df-eed165bdd3a9 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:12.565877 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f86f8551-fde2-48e8-a2df-eed165bdd3a9 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:12.567292 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f86f8551-fde2-48e8-a2df-eed165bdd3a9 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:12.567727 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f86f8551-fde2-48e8-a2df-eed165bdd3a9 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:12.688255 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-09eabf8d-91c5-4960-bc3a-e6740c4cea10 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:12.695997 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-09eabf8d-91c5-4960-bc3a-e6740c4cea10 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:12.697499 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-09eabf8d-91c5-4960-bc3a-e6740c4cea10 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:12.698655 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-09eabf8d-91c5-4960-bc3a-e6740c4cea10 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.154304 Nov 21 13:54:12.699219 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 208/405] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:12 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:12.702946 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-f86f8551-fde2-48e8-a2df-eed165bdd3a9 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:12.711102 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-f86f8551-fde2-48e8-a2df-eed165bdd3a9 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1260 microversion: 2.1 time: 0.156507 Nov 21 13:54:12.711654 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 198/406] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:12 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:13.093409 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-eb14494a-4afb-48e0-ab6e-ba3516a0b280 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:13.094007 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-eb14494a-4afb-48e0-ab6e-ba3516a0b280 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:13.100578 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-eb14494a-4afb-48e0-ab6e-ba3516a0b280 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:13.101031 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-eb14494a-4afb-48e0-ab6e-ba3516a0b280 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:13.101815 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-eb14494a-4afb-48e0-ab6e-ba3516a0b280 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:13.102248 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-eb14494a-4afb-48e0-ab6e-ba3516a0b280 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:13.110149 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-80babc58-32a6-40f4-b650-54ff68ceacec tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:13.110789 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-80babc58-32a6-40f4-b650-54ff68ceacec tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:13.117037 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-80babc58-32a6-40f4-b650-54ff68ceacec tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:13.117489 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-80babc58-32a6-40f4-b650-54ff68ceacec tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:13.118259 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-80babc58-32a6-40f4-b650-54ff68ceacec tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:13.118691 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-80babc58-32a6-40f4-b650-54ff68ceacec tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:13.234122 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-eb14494a-4afb-48e0-ab6e-ba3516a0b280 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:13.242577 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-eb14494a-4afb-48e0-ab6e-ba3516a0b280 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.152876 Nov 21 13:54:13.243237 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 209/407] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:13 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:13.248114 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-80babc58-32a6-40f4-b650-54ff68ceacec tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:13.256620 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-80babc58-32a6-40f4-b650-54ff68ceacec tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1723 microversion: 2.1 time: 0.150199 Nov 21 13:54:13.257161 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 199/408] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:13 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:13.717766 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-5da1488e-9a3e-479c-ae58-d5687b343dd7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:13.718365 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-5da1488e-9a3e-479c-ae58-d5687b343dd7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:13.724732 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5da1488e-9a3e-479c-ae58-d5687b343dd7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:13.725184 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5da1488e-9a3e-479c-ae58-d5687b343dd7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:13.725960 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5da1488e-9a3e-479c-ae58-d5687b343dd7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:13.726397 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5da1488e-9a3e-479c-ae58-d5687b343dd7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:13.728513 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a49facfe-4d02-4286-ac39-11e7e9bad83e tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:13.729134 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a49facfe-4d02-4286-ac39-11e7e9bad83e tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:13.736720 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a49facfe-4d02-4286-ac39-11e7e9bad83e tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:13.737490 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a49facfe-4d02-4286-ac39-11e7e9bad83e tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:13.738757 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a49facfe-4d02-4286-ac39-11e7e9bad83e tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:13.739213 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a49facfe-4d02-4286-ac39-11e7e9bad83e tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:13.873855 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-5da1488e-9a3e-479c-ae58-d5687b343dd7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:13.883031 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-5da1488e-9a3e-479c-ae58-d5687b343dd7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:13.883984 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a49facfe-4d02-4286-ac39-11e7e9bad83e tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:13.884803 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-5da1488e-9a3e-479c-ae58-d5687b343dd7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:13.886199 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-5da1488e-9a3e-479c-ae58-d5687b343dd7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.172159 Nov 21 13:54:13.886976 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 210/409] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:13 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:13.892262 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a49facfe-4d02-4286-ac39-11e7e9bad83e tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1260 microversion: 2.1 time: 0.168194 Nov 21 13:54:13.893075 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 200/410] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:13 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:13.933397 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-3ac00ee6-b43b-4ffc-9aa7-5827388210a9 req-f83bb786-da05-4e87-a31e-9f5db392ea7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2707c966-28e3-43ba-9241-d5629ba92b06", "name": "network-vif-plugged", "status": "completed", "tag": "5907d47d-9ae0-44a4-adf8-9e5e784f851a"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:54:13.935002 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:54:13.935002 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:54:13.943717 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-3ac00ee6-b43b-4ffc-9aa7-5827388210a9 req-f83bb786-da05-4e87-a31e-9f5db392ea7a service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:13.944201 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-3ac00ee6-b43b-4ffc-9aa7-5827388210a9 req-f83bb786-da05-4e87-a31e-9f5db392ea7a service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:13.955979 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-3ac00ee6-b43b-4ffc-9aa7-5827388210a9 req-f83bb786-da05-4e87-a31e-9f5db392ea7a service nova] Creating event network-vif-plugged:5907d47d-9ae0-44a4-adf8-9e5e784f851a for instance 2707c966-28e3-43ba-9241-d5629ba92b06 on hv-cinder-76845 Nov 21 13:54:13.961389 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-3ac00ee6-b43b-4ffc-9aa7-5827388210a9 req-f83bb786-da05-4e87-a31e-9f5db392ea7a service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031862 Nov 21 13:54:13.962017 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 211/411] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:54:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:54:14.259972 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-41d4f823-8267-4ac5-9c2f-f094614a508a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:14.260580 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-41d4f823-8267-4ac5-9c2f-f094614a508a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:14.266318 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-41d4f823-8267-4ac5-9c2f-f094614a508a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:14.266761 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-41d4f823-8267-4ac5-9c2f-f094614a508a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:14.267534 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-41d4f823-8267-4ac5-9c2f-f094614a508a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:14.267997 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-41d4f823-8267-4ac5-9c2f-f094614a508a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:14.274341 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-a27f1233-c3aa-4d67-8767-01708d2d8699 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:14.275233 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-a27f1233-c3aa-4d67-8767-01708d2d8699 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:14.281518 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a27f1233-c3aa-4d67-8767-01708d2d8699 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:14.281967 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a27f1233-c3aa-4d67-8767-01708d2d8699 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:14.282768 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a27f1233-c3aa-4d67-8767-01708d2d8699 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:14.283261 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a27f1233-c3aa-4d67-8767-01708d2d8699 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:14.409336 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-41d4f823-8267-4ac5-9c2f-f094614a508a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:14.417139 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-41d4f823-8267-4ac5-9c2f-f094614a508a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.160840 Nov 21 13:54:14.417697 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 201/412] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:14 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:14.422960 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-a27f1233-c3aa-4d67-8767-01708d2d8699 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:14.431179 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-a27f1233-c3aa-4d67-8767-01708d2d8699 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1723 microversion: 2.1 time: 0.160926 Nov 21 13:54:14.431727 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 212/413] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:14 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:14.904950 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-8924b874-9841-4cf7-a765-cdcb61e50564 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:14.905809 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-8924b874-9841-4cf7-a765-cdcb61e50564 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:14.908976 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-0dc057c8-5cb3-4d41-aa4c-c9b2dff41946 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:14.909581 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-0dc057c8-5cb3-4d41-aa4c-c9b2dff41946 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:14.913432 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8924b874-9841-4cf7-a765-cdcb61e50564 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:14.913897 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8924b874-9841-4cf7-a765-cdcb61e50564 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:14.914719 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8924b874-9841-4cf7-a765-cdcb61e50564 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:14.915176 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8924b874-9841-4cf7-a765-cdcb61e50564 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:14.917141 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0dc057c8-5cb3-4d41-aa4c-c9b2dff41946 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:14.917598 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0dc057c8-5cb3-4d41-aa4c-c9b2dff41946 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:14.918359 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0dc057c8-5cb3-4d41-aa4c-c9b2dff41946 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:14.918792 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0dc057c8-5cb3-4d41-aa4c-c9b2dff41946 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:15.066824 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-0dc057c8-5cb3-4d41-aa4c-c9b2dff41946 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:15.078298 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-0dc057c8-5cb3-4d41-aa4c-c9b2dff41946 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1260 microversion: 2.1 time: 0.173083 Nov 21 13:54:15.078534 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-8924b874-9841-4cf7-a765-cdcb61e50564 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:15.088267 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-8924b874-9841-4cf7-a765-cdcb61e50564 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:15.093766 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-8924b874-9841-4cf7-a765-cdcb61e50564 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:15.105072 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 213/414] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:14 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:15.105319 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-8924b874-9841-4cf7-a765-cdcb61e50564 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.200722 Nov 21 13:54:15.105319 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 202/415] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:14 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:15.435397 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-388be2cc-e076-49f5-beb7-ae00b5c88ed7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:15.436034 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-388be2cc-e076-49f5-beb7-ae00b5c88ed7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:15.442380 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-388be2cc-e076-49f5-beb7-ae00b5c88ed7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:15.442834 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-388be2cc-e076-49f5-beb7-ae00b5c88ed7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:15.443605 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-388be2cc-e076-49f5-beb7-ae00b5c88ed7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:15.444065 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-388be2cc-e076-49f5-beb7-ae00b5c88ed7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:15.448202 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-01d4bbcc-ab6d-4293-b85b-1171674da9f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:15.448902 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-01d4bbcc-ab6d-4293-b85b-1171674da9f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:15.454705 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-01d4bbcc-ab6d-4293-b85b-1171674da9f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:15.455266 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-01d4bbcc-ab6d-4293-b85b-1171674da9f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:15.456073 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-01d4bbcc-ab6d-4293-b85b-1171674da9f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:15.456590 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-01d4bbcc-ab6d-4293-b85b-1171674da9f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:15.586137 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-388be2cc-e076-49f5-beb7-ae00b5c88ed7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:15.595183 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-388be2cc-e076-49f5-beb7-ae00b5c88ed7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.163505 Nov 21 13:54:15.600004 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-01d4bbcc-ab6d-4293-b85b-1171674da9f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:15.603653 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 214/416] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:15 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:15.609301 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-01d4bbcc-ab6d-4293-b85b-1171674da9f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1723 microversion: 2.1 time: 0.164711 Nov 21 13:54:15.609926 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 203/417] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:15 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:16.095675 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2986167a-8ccc-413f-bf2b-246f6e3cdc48 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:16.096328 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-2986167a-8ccc-413f-bf2b-246f6e3cdc48 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:16.102540 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2986167a-8ccc-413f-bf2b-246f6e3cdc48 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:16.102992 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2986167a-8ccc-413f-bf2b-246f6e3cdc48 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:16.103758 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2986167a-8ccc-413f-bf2b-246f6e3cdc48 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:16.104214 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2986167a-8ccc-413f-bf2b-246f6e3cdc48 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:16.119347 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-282d6618-afec-4212-8b87-cf7f396d3d1a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:16.120037 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-282d6618-afec-4212-8b87-cf7f396d3d1a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:16.128551 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-282d6618-afec-4212-8b87-cf7f396d3d1a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:16.129507 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-282d6618-afec-4212-8b87-cf7f396d3d1a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:16.130310 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-282d6618-afec-4212-8b87-cf7f396d3d1a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:16.130811 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-282d6618-afec-4212-8b87-cf7f396d3d1a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:16.256542 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-2986167a-8ccc-413f-bf2b-246f6e3cdc48 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:16.265893 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-2986167a-8ccc-413f-bf2b-246f6e3cdc48 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1445 microversion: 2.1 time: 0.173813 Nov 21 13:54:16.278248 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 215/418] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:16 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1445 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:16.288456 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-502d163b-406d-41af-868d-14f10d17e0ce tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:16.288456 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-502d163b-406d-41af-868d-14f10d17e0ce tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:16.294180 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-502d163b-406d-41af-868d-14f10d17e0ce tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:16.294744 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-502d163b-406d-41af-868d-14f10d17e0ce tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:16.295613 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-502d163b-406d-41af-868d-14f10d17e0ce tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:16.297098 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-502d163b-406d-41af-868d-14f10d17e0ce tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:16.302789 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-282d6618-afec-4212-8b87-cf7f396d3d1a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:16.312496 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-282d6618-afec-4212-8b87-cf7f396d3d1a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:16.313999 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-282d6618-afec-4212-8b87-cf7f396d3d1a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:16.315150 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-282d6618-afec-4212-8b87-cf7f396d3d1a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.199534 Nov 21 13:54:16.315889 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 204/419] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:16 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 13:54:16.442561 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-502d163b-406d-41af-868d-14f10d17e0ce tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:16.450025 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-502d163b-406d-41af-868d-14f10d17e0ce tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1445 microversion: 2.1 time: 0.170398 Nov 21 13:54:16.450673 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 216/420] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:16 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1445 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:16.620265 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-9c565c21-2a1e-4184-bd77-537aea974138 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:16.620876 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-9c565c21-2a1e-4184-bd77-537aea974138 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:16.626137 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-a23befe8-3339-4081-9a8f-10fcb7b19bfe tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:16.627142 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-a23befe8-3339-4081-9a8f-10fcb7b19bfe tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:16.627395 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9c565c21-2a1e-4184-bd77-537aea974138 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:16.628062 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9c565c21-2a1e-4184-bd77-537aea974138 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:16.629066 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9c565c21-2a1e-4184-bd77-537aea974138 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:16.630203 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9c565c21-2a1e-4184-bd77-537aea974138 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:16.634455 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a23befe8-3339-4081-9a8f-10fcb7b19bfe tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:16.634925 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a23befe8-3339-4081-9a8f-10fcb7b19bfe tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:16.635860 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a23befe8-3339-4081-9a8f-10fcb7b19bfe tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:16.636402 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a23befe8-3339-4081-9a8f-10fcb7b19bfe tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:16.778071 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-9c565c21-2a1e-4184-bd77-537aea974138 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:16.786761 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-9c565c21-2a1e-4184-bd77-537aea974138 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.170094 Nov 21 13:54:16.787332 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 205/421] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:16 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:16.832000 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-a23befe8-3339-4081-9a8f-10fcb7b19bfe tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:16.840100 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-a23befe8-3339-4081-9a8f-10fcb7b19bfe tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1723 microversion: 2.1 time: 0.217613 Nov 21 13:54:16.840714 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 217/422] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:16 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:17.336001 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-66e8dd5b-af34-471a-a942-03d5d352fb87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:17.336676 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-66e8dd5b-af34-471a-a942-03d5d352fb87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:17.343198 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-66e8dd5b-af34-471a-a942-03d5d352fb87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:17.343729 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-66e8dd5b-af34-471a-a942-03d5d352fb87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:17.344637 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-66e8dd5b-af34-471a-a942-03d5d352fb87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:17.345143 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-66e8dd5b-af34-471a-a942-03d5d352fb87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:17.505629 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-66e8dd5b-af34-471a-a942-03d5d352fb87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:17.513555 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-66e8dd5b-af34-471a-a942-03d5d352fb87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:17.515179 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-66e8dd5b-af34-471a-a942-03d5d352fb87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:17.516587 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-66e8dd5b-af34-471a-a942-03d5d352fb87 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.184851 Nov 21 13:54:17.517636 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 206/423] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:17 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:17.804500 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-7d6fbc4e-862c-4b58-a55d-e5fe56259a5b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:17.805142 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-7d6fbc4e-862c-4b58-a55d-e5fe56259a5b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:17.811409 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7d6fbc4e-862c-4b58-a55d-e5fe56259a5b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:17.811895 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7d6fbc4e-862c-4b58-a55d-e5fe56259a5b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:17.812684 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7d6fbc4e-862c-4b58-a55d-e5fe56259a5b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:17.813310 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7d6fbc4e-862c-4b58-a55d-e5fe56259a5b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:17.858740 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-98f06c65-5422-446f-92b0-91f4d9a8fa66 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:17.859351 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-98f06c65-5422-446f-92b0-91f4d9a8fa66 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:17.865272 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-98f06c65-5422-446f-92b0-91f4d9a8fa66 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:17.865760 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-98f06c65-5422-446f-92b0-91f4d9a8fa66 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:17.866540 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-98f06c65-5422-446f-92b0-91f4d9a8fa66 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:17.867051 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-98f06c65-5422-446f-92b0-91f4d9a8fa66 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:17.999945 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-98f06c65-5422-446f-92b0-91f4d9a8fa66 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:18.008839 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-98f06c65-5422-446f-92b0-91f4d9a8fa66 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1723 microversion: 2.1 time: 0.153613 Nov 21 13:54:18.009018 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 207/424] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:17 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:18.057629 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-7d6fbc4e-862c-4b58-a55d-e5fe56259a5b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:18.065455 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-7d6fbc4e-862c-4b58-a55d-e5fe56259a5b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.265142 Nov 21 13:54:18.066026 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 218/425] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:17 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:18.518295 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-1978fc6c-da66-455a-b12f-a847a27a58eb req-a221ec0e-b6ab-44da-8af5-a6aedb6ba824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2707c966-28e3-43ba-9241-d5629ba92b06", "tag": "5907d47d-9ae0-44a4-adf8-9e5e784f851a"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:54:18.520489 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:54:18.520489 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:54:18.527719 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-1978fc6c-da66-455a-b12f-a847a27a58eb req-a221ec0e-b6ab-44da-8af5-a6aedb6ba824 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:18.528191 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-1978fc6c-da66-455a-b12f-a847a27a58eb req-a221ec0e-b6ab-44da-8af5-a6aedb6ba824 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:18.535914 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2911ad36-3746-4e4a-aecd-15de1bd26635 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:18.536852 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-2911ad36-3746-4e4a-aecd-15de1bd26635 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:18.540431 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-1978fc6c-da66-455a-b12f-a847a27a58eb req-a221ec0e-b6ab-44da-8af5-a6aedb6ba824 service nova] Creating event network-changed:5907d47d-9ae0-44a4-adf8-9e5e784f851a for instance 2707c966-28e3-43ba-9241-d5629ba92b06 on hv-cinder-76845 Nov 21 13:54:18.545101 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2911ad36-3746-4e4a-aecd-15de1bd26635 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:18.545898 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2911ad36-3746-4e4a-aecd-15de1bd26635 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:18.546043 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-1978fc6c-da66-455a-b12f-a847a27a58eb req-a221ec0e-b6ab-44da-8af5-a6aedb6ba824 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032160 Nov 21 13:54:18.546831 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2911ad36-3746-4e4a-aecd-15de1bd26635 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:18.546962 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 208/426] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:54:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:54:18.547419 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2911ad36-3746-4e4a-aecd-15de1bd26635 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:18.723436 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-2911ad36-3746-4e4a-aecd-15de1bd26635 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:18.732235 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-2911ad36-3746-4e4a-aecd-15de1bd26635 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:18.734190 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-2911ad36-3746-4e4a-aecd-15de1bd26635 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:18.735390 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-2911ad36-3746-4e4a-aecd-15de1bd26635 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.203921 Nov 21 13:54:18.736213 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 219/427] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:18 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:19.025325 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-93de7d82-a12e-495f-bc1c-880eefe526bd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:19.026030 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-93de7d82-a12e-495f-bc1c-880eefe526bd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:19.032247 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-93de7d82-a12e-495f-bc1c-880eefe526bd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:19.032705 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-93de7d82-a12e-495f-bc1c-880eefe526bd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:19.033823 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-93de7d82-a12e-495f-bc1c-880eefe526bd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:19.034266 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-93de7d82-a12e-495f-bc1c-880eefe526bd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:19.083139 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-0687fea6-f12d-4365-8a2c-055f65b6314a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:19.083756 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-0687fea6-f12d-4365-8a2c-055f65b6314a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:19.090716 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0687fea6-f12d-4365-8a2c-055f65b6314a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:19.091160 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0687fea6-f12d-4365-8a2c-055f65b6314a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:19.091995 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0687fea6-f12d-4365-8a2c-055f65b6314a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:19.092439 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0687fea6-f12d-4365-8a2c-055f65b6314a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:19.242664 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-0687fea6-f12d-4365-8a2c-055f65b6314a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:19.252449 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-0687fea6-f12d-4365-8a2c-055f65b6314a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.173664 Nov 21 13:54:19.261434 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-93de7d82-a12e-495f-bc1c-880eefe526bd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:19.262231 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 220/428] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:19 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:19.270958 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-93de7d82-a12e-495f-bc1c-880eefe526bd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1723 microversion: 2.1 time: 0.249697 Nov 21 13:54:19.271771 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 209/429] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:19 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:19.754804 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-c39508d6-f32f-4ead-837a-c9e28121733e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:19.755425 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-c39508d6-f32f-4ead-837a-c9e28121733e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:19.761372 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c39508d6-f32f-4ead-837a-c9e28121733e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:19.761853 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c39508d6-f32f-4ead-837a-c9e28121733e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:19.762620 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c39508d6-f32f-4ead-837a-c9e28121733e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:19.763168 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c39508d6-f32f-4ead-837a-c9e28121733e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:19.895284 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-c39508d6-f32f-4ead-837a-c9e28121733e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:19.905859 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-c39508d6-f32f-4ead-837a-c9e28121733e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:19.907694 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-c39508d6-f32f-4ead-837a-c9e28121733e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:19.908884 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-c39508d6-f32f-4ead-837a-c9e28121733e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.158780 Nov 21 13:54:19.909436 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 221/430] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:19 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:20.269413 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-6266902b-c4d3-4dcd-b1bb-4377ee2da98e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:20.271102 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-6266902b-c4d3-4dcd-b1bb-4377ee2da98e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:20.277653 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6266902b-c4d3-4dcd-b1bb-4377ee2da98e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:20.278131 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6266902b-c4d3-4dcd-b1bb-4377ee2da98e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:20.278912 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6266902b-c4d3-4dcd-b1bb-4377ee2da98e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:20.279349 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6266902b-c4d3-4dcd-b1bb-4377ee2da98e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:20.296264 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-3eeebe69-0c82-4820-b9ff-34e69b947953 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:20.296971 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3eeebe69-0c82-4820-b9ff-34e69b947953 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:20.303304 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3eeebe69-0c82-4820-b9ff-34e69b947953 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:20.304072 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3eeebe69-0c82-4820-b9ff-34e69b947953 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:20.304918 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3eeebe69-0c82-4820-b9ff-34e69b947953 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:20.305553 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3eeebe69-0c82-4820-b9ff-34e69b947953 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:20.446500 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-6266902b-c4d3-4dcd-b1bb-4377ee2da98e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:20.454552 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-6266902b-c4d3-4dcd-b1bb-4377ee2da98e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.188860 Nov 21 13:54:20.455118 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 210/431] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:20 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:20.472723 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-3eeebe69-0c82-4820-b9ff-34e69b947953 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:20.480712 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-3eeebe69-0c82-4820-b9ff-34e69b947953 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1723 microversion: 2.1 time: 0.188937 Nov 21 13:54:20.481281 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 222/432] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:20 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:20.928218 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-5f9bafce-9ab6-4472-b46d-cc17ddfd03e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:20.928781 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-5f9bafce-9ab6-4472-b46d-cc17ddfd03e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:20.934687 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5f9bafce-9ab6-4472-b46d-cc17ddfd03e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:20.935133 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5f9bafce-9ab6-4472-b46d-cc17ddfd03e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:20.935938 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5f9bafce-9ab6-4472-b46d-cc17ddfd03e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:20.936360 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5f9bafce-9ab6-4472-b46d-cc17ddfd03e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:21.071141 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-5f9bafce-9ab6-4472-b46d-cc17ddfd03e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:21.078773 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-5f9bafce-9ab6-4472-b46d-cc17ddfd03e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:21.080296 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-5f9bafce-9ab6-4472-b46d-cc17ddfd03e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:21.081469 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-5f9bafce-9ab6-4472-b46d-cc17ddfd03e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.157547 Nov 21 13:54:21.082032 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 211/433] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:20 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:21.472373 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-c4a4f20c-3f8f-4f24-936a-27eb91a8d4a2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:21.472980 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-c4a4f20c-3f8f-4f24-936a-27eb91a8d4a2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:21.480167 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c4a4f20c-3f8f-4f24-936a-27eb91a8d4a2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:21.480615 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c4a4f20c-3f8f-4f24-936a-27eb91a8d4a2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:21.481384 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c4a4f20c-3f8f-4f24-936a-27eb91a8d4a2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:21.481816 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c4a4f20c-3f8f-4f24-936a-27eb91a8d4a2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:21.499896 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a372de22-09da-48a9-a0e6-fcc1ad4291b0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:21.500513 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a372de22-09da-48a9-a0e6-fcc1ad4291b0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:21.506963 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a372de22-09da-48a9-a0e6-fcc1ad4291b0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:21.507416 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a372de22-09da-48a9-a0e6-fcc1ad4291b0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:21.508231 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a372de22-09da-48a9-a0e6-fcc1ad4291b0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:21.508666 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a372de22-09da-48a9-a0e6-fcc1ad4291b0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:21.613009 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-c4a4f20c-3f8f-4f24-936a-27eb91a8d4a2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:21.620912 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-c4a4f20c-3f8f-4f24-936a-27eb91a8d4a2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.152260 Nov 21 13:54:21.621593 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 223/434] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:21 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:21.644738 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a372de22-09da-48a9-a0e6-fcc1ad4291b0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:21.653247 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a372de22-09da-48a9-a0e6-fcc1ad4291b0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1723 microversion: 2.1 time: 0.156988 Nov 21 13:54:21.653915 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 212/435] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:21 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:22.099521 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-a140451e-8552-4e88-9e82-1837c51ca13f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:22.100170 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-a140451e-8552-4e88-9e82-1837c51ca13f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:22.106012 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a140451e-8552-4e88-9e82-1837c51ca13f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:22.106462 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a140451e-8552-4e88-9e82-1837c51ca13f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:22.107238 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a140451e-8552-4e88-9e82-1837c51ca13f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:22.107677 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a140451e-8552-4e88-9e82-1837c51ca13f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:22.231873 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-a140451e-8552-4e88-9e82-1837c51ca13f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:22.239501 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-a140451e-8552-4e88-9e82-1837c51ca13f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:22.241040 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-a140451e-8552-4e88-9e82-1837c51ca13f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:22.242182 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-a140451e-8552-4e88-9e82-1837c51ca13f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1746 microversion: 2.20 time: 0.146381 Nov 21 13:54:22.242737 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 224/436] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:22 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1746 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:22.638104 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-b406f7e0-55ff-46ae-b337-fb70a5815430 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:22.638721 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-b406f7e0-55ff-46ae-b337-fb70a5815430 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:22.644961 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b406f7e0-55ff-46ae-b337-fb70a5815430 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:22.645412 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b406f7e0-55ff-46ae-b337-fb70a5815430 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:22.646191 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b406f7e0-55ff-46ae-b337-fb70a5815430 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:22.646629 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b406f7e0-55ff-46ae-b337-fb70a5815430 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:22.670143 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ad3f2dcf-bfb1-43a0-b346-2607865a790c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:22.670856 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ad3f2dcf-bfb1-43a0-b346-2607865a790c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:22.677911 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ad3f2dcf-bfb1-43a0-b346-2607865a790c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:22.678360 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ad3f2dcf-bfb1-43a0-b346-2607865a790c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:22.679143 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ad3f2dcf-bfb1-43a0-b346-2607865a790c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:22.679578 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ad3f2dcf-bfb1-43a0-b346-2607865a790c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:22.779629 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-b406f7e0-55ff-46ae-b337-fb70a5815430 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:22.788021 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-b406f7e0-55ff-46ae-b337-fb70a5815430 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.153517 Nov 21 13:54:22.788598 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 213/437] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:22 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:22.815431 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-ad3f2dcf-bfb1-43a0-b346-2607865a790c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:22.823144 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ad3f2dcf-bfb1-43a0-b346-2607865a790c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1700 microversion: 2.1 time: 0.156670 Nov 21 13:54:22.823707 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 225/438] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:22 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1700 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:22.838876 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ec1afb12-ac86-49bb-8fa1-fd42337fd1a0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:54:22.845328 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ec1afb12-ac86-49bb-8fa1-fd42337fd1a0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:22.845776 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ec1afb12-ac86-49bb-8fa1-fd42337fd1a0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:22.869422 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ec1afb12-ac86-49bb-8fa1-fd42337fd1a0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Going to try to start instance {{(pid=122565) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 21 13:54:22.908030 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ec1afb12-ac86-49bb-8fa1-fd42337fd1a0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 202 len: 0 microversion: 2.1 time: 0.072581 Nov 21 13:54:22.908624 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 214/439] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:54:22 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:54:22.917087 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-8ba7e33e-24ab-4d87-b93e-1367d880db54 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:22.917821 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-8ba7e33e-24ab-4d87-b93e-1367d880db54 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:22.923728 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8ba7e33e-24ab-4d87-b93e-1367d880db54 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:22.924426 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8ba7e33e-24ab-4d87-b93e-1367d880db54 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:22.925279 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8ba7e33e-24ab-4d87-b93e-1367d880db54 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:22.925727 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8ba7e33e-24ab-4d87-b93e-1367d880db54 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:23.060048 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-8ba7e33e-24ab-4d87-b93e-1367d880db54 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:23.068696 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-8ba7e33e-24ab-4d87-b93e-1367d880db54 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1709 microversion: 2.1 time: 0.155240 Nov 21 13:54:23.069295 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 226/440] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:22 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1709 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:23.261291 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-84fde8de-f6cb-4edf-afc2-68f84364de4b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:23.262026 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-84fde8de-f6cb-4edf-afc2-68f84364de4b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:23.268087 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-84fde8de-f6cb-4edf-afc2-68f84364de4b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:23.268547 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-84fde8de-f6cb-4edf-afc2-68f84364de4b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:23.269331 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-84fde8de-f6cb-4edf-afc2-68f84364de4b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:23.269771 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-84fde8de-f6cb-4edf-afc2-68f84364de4b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:23.486098 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-84fde8de-f6cb-4edf-afc2-68f84364de4b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:23.493755 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-84fde8de-f6cb-4edf-afc2-68f84364de4b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:23.495244 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-84fde8de-f6cb-4edf-afc2-68f84364de4b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:23.496417 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-84fde8de-f6cb-4edf-afc2-68f84364de4b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1746 microversion: 2.20 time: 0.239232 Nov 21 13:54:23.496970 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 215/441] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:23 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1746 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 13:54:23.808023 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-95ce89a1-9c0e-403f-b2af-c48772ce208e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:23.809407 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-95ce89a1-9c0e-403f-b2af-c48772ce208e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:23.815576 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-95ce89a1-9c0e-403f-b2af-c48772ce208e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:23.816066 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-95ce89a1-9c0e-403f-b2af-c48772ce208e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:23.816850 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-95ce89a1-9c0e-403f-b2af-c48772ce208e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:23.817286 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-95ce89a1-9c0e-403f-b2af-c48772ce208e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:23.943029 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-95ce89a1-9c0e-403f-b2af-c48772ce208e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:23.950794 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-95ce89a1-9c0e-403f-b2af-c48772ce208e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.149501 Nov 21 13:54:23.951666 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 227/442] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:23 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:24.086604 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-2dff8d2e-cad2-48e8-ab4f-91b5da087bb1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:24.087221 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-2dff8d2e-cad2-48e8-ab4f-91b5da087bb1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:24.093496 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2dff8d2e-cad2-48e8-ab4f-91b5da087bb1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:24.093948 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2dff8d2e-cad2-48e8-ab4f-91b5da087bb1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:24.094730 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2dff8d2e-cad2-48e8-ab4f-91b5da087bb1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:24.095170 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2dff8d2e-cad2-48e8-ab4f-91b5da087bb1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:24.227711 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2dff8d2e-cad2-48e8-ab4f-91b5da087bb1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:24.235369 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-2dff8d2e-cad2-48e8-ab4f-91b5da087bb1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1709 microversion: 2.1 time: 0.153068 Nov 21 13:54:24.235963 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 216/443] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:24 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1709 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:24.515459 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-bba13aaf-c055-4077-be97-b796063fc43a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:24.516021 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-bba13aaf-c055-4077-be97-b796063fc43a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:24.522479 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bba13aaf-c055-4077-be97-b796063fc43a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:24.522931 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bba13aaf-c055-4077-be97-b796063fc43a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:24.523705 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bba13aaf-c055-4077-be97-b796063fc43a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:24.524169 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bba13aaf-c055-4077-be97-b796063fc43a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:24.652132 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-bba13aaf-c055-4077-be97-b796063fc43a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:24.659774 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-bba13aaf-c055-4077-be97-b796063fc43a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:24.661382 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-bba13aaf-c055-4077-be97-b796063fc43a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:24.662584 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-bba13aaf-c055-4077-be97-b796063fc43a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1746 microversion: 2.20 time: 0.150920 Nov 21 13:54:24.663136 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 228/444] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:24 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:24.977542 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-820463a8-c5f9-4dfe-ba8b-56596cc17406 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:24.978248 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-820463a8-c5f9-4dfe-ba8b-56596cc17406 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:24.991098 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-820463a8-c5f9-4dfe-ba8b-56596cc17406 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:24.991640 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-820463a8-c5f9-4dfe-ba8b-56596cc17406 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:24.992677 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-820463a8-c5f9-4dfe-ba8b-56596cc17406 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:24.993510 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-820463a8-c5f9-4dfe-ba8b-56596cc17406 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:25.146406 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-820463a8-c5f9-4dfe-ba8b-56596cc17406 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:25.154226 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-820463a8-c5f9-4dfe-ba8b-56596cc17406 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.188913 Nov 21 13:54:25.154789 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 217/445] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:24 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:25.252487 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-3fad6c09-28f1-4300-8257-60cf35987b92 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:25.253245 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3fad6c09-28f1-4300-8257-60cf35987b92 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:25.260494 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3fad6c09-28f1-4300-8257-60cf35987b92 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:25.260945 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3fad6c09-28f1-4300-8257-60cf35987b92 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:25.261718 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3fad6c09-28f1-4300-8257-60cf35987b92 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:25.262202 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3fad6c09-28f1-4300-8257-60cf35987b92 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:25.436855 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-3fad6c09-28f1-4300-8257-60cf35987b92 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:25.445839 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-3fad6c09-28f1-4300-8257-60cf35987b92 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1713 microversion: 2.1 time: 0.197150 Nov 21 13:54:25.446497 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 229/446] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:25 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1713 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:25.685741 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a5340705-fb44-433a-b494-1f68df417f7b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:25.686605 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a5340705-fb44-433a-b494-1f68df417f7b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:25.694252 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a5340705-fb44-433a-b494-1f68df417f7b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:25.694702 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a5340705-fb44-433a-b494-1f68df417f7b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:25.695482 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a5340705-fb44-433a-b494-1f68df417f7b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:25.695949 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a5340705-fb44-433a-b494-1f68df417f7b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:25.846266 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a5340705-fb44-433a-b494-1f68df417f7b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:25.855635 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a5340705-fb44-433a-b494-1f68df417f7b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:25.858384 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a5340705-fb44-433a-b494-1f68df417f7b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:25.858785 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a5340705-fb44-433a-b494-1f68df417f7b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1741 microversion: 2.20 time: 0.179451 Nov 21 13:54:25.859489 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 218/447] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:25 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:26.009025 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-3280d231-4879-497d-870f-c0980da08ecc req-28633a24-ea1c-4909-a714-b8af43dc42b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e92c59-3be1-41c7-8ea1-b1bb65cf39c1", "name": "network-vif-plugged", "status": "completed", "tag": "627d561d-d2ff-449e-a99f-9e5e3fd874ba"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:54:26.011011 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:54:26.011011 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:54:26.019856 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-3280d231-4879-497d-870f-c0980da08ecc req-28633a24-ea1c-4909-a714-b8af43dc42b1 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:26.021148 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-3280d231-4879-497d-870f-c0980da08ecc req-28633a24-ea1c-4909-a714-b8af43dc42b1 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:26.034220 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-3280d231-4879-497d-870f-c0980da08ecc req-28633a24-ea1c-4909-a714-b8af43dc42b1 service nova] Creating event network-vif-plugged:627d561d-d2ff-449e-a99f-9e5e3fd874ba for instance 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 on hv-cinder-76845 Nov 21 13:54:26.040311 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-3280d231-4879-497d-870f-c0980da08ecc req-28633a24-ea1c-4909-a714-b8af43dc42b1 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034679 Nov 21 13:54:26.041086 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 230/448] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:54:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:54:26.171881 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-92f6abf8-495b-4a9e-a0e6-978989eb0164 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:26.173087 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-92f6abf8-495b-4a9e-a0e6-978989eb0164 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:26.180054 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-92f6abf8-495b-4a9e-a0e6-978989eb0164 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:26.180510 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-92f6abf8-495b-4a9e-a0e6-978989eb0164 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:26.181296 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-92f6abf8-495b-4a9e-a0e6-978989eb0164 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:26.181732 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-92f6abf8-495b-4a9e-a0e6-978989eb0164 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:26.356969 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-92f6abf8-495b-4a9e-a0e6-978989eb0164 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:26.367604 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-92f6abf8-495b-4a9e-a0e6-978989eb0164 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.199274 Nov 21 13:54:26.376333 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 219/449] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:26 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:26.880093 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-8c92b534-230b-49ba-8600-f9197242aacf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:26.880816 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-8c92b534-230b-49ba-8600-f9197242aacf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:26.944561 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8c92b534-230b-49ba-8600-f9197242aacf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:26.945696 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8c92b534-230b-49ba-8600-f9197242aacf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.047s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:26.946783 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8c92b534-230b-49ba-8600-f9197242aacf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:26.947440 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8c92b534-230b-49ba-8600-f9197242aacf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:27.153992 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-8c92b534-230b-49ba-8600-f9197242aacf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:27.164250 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-8c92b534-230b-49ba-8600-f9197242aacf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:27.165925 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-8c92b534-230b-49ba-8600-f9197242aacf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:27.167277 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-8c92b534-230b-49ba-8600-f9197242aacf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1741 microversion: 2.20 time: 0.292259 Nov 21 13:54:27.167872 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 231/450] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:26 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1741 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:27.385904 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ab963b14-4979-4ef1-9fc6-f2e5fa91aa33 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:27.387468 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ab963b14-4979-4ef1-9fc6-f2e5fa91aa33 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:27.394368 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ab963b14-4979-4ef1-9fc6-f2e5fa91aa33 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:27.395582 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ab963b14-4979-4ef1-9fc6-f2e5fa91aa33 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:27.397325 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ab963b14-4979-4ef1-9fc6-f2e5fa91aa33 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:27.398131 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ab963b14-4979-4ef1-9fc6-f2e5fa91aa33 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:27.559739 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ab963b14-4979-4ef1-9fc6-f2e5fa91aa33 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:27.568614 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ab963b14-4979-4ef1-9fc6-f2e5fa91aa33 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.186742 Nov 21 13:54:27.580242 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 220/451] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:27 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:28.187695 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-cae0b710-8eff-4b10-a3e4-fdf91b15ad4e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:28.188344 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-cae0b710-8eff-4b10-a3e4-fdf91b15ad4e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:28.196494 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cae0b710-8eff-4b10-a3e4-fdf91b15ad4e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:28.197362 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cae0b710-8eff-4b10-a3e4-fdf91b15ad4e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:28.198386 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cae0b710-8eff-4b10-a3e4-fdf91b15ad4e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:28.199072 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cae0b710-8eff-4b10-a3e4-fdf91b15ad4e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:28.346130 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-cae0b710-8eff-4b10-a3e4-fdf91b15ad4e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:28.356276 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-cae0b710-8eff-4b10-a3e4-fdf91b15ad4e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:28.358388 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-cae0b710-8eff-4b10-a3e4-fdf91b15ad4e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:28.359563 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-cae0b710-8eff-4b10-a3e4-fdf91b15ad4e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1741 microversion: 2.20 time: 0.177706 Nov 21 13:54:28.360476 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 232/452] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:28 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:28.588321 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-9f4564f8-891f-40e1-a9f2-9ab2f07162a8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:28.588950 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-9f4564f8-891f-40e1-a9f2-9ab2f07162a8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:28.596843 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9f4564f8-891f-40e1-a9f2-9ab2f07162a8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:28.596843 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9f4564f8-891f-40e1-a9f2-9ab2f07162a8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:28.598097 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9f4564f8-891f-40e1-a9f2-9ab2f07162a8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:28.598576 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9f4564f8-891f-40e1-a9f2-9ab2f07162a8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:28.744734 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-9f4564f8-891f-40e1-a9f2-9ab2f07162a8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:28.755297 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-9f4564f8-891f-40e1-a9f2-9ab2f07162a8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.170132 Nov 21 13:54:28.756446 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 221/453] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:28 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:29.377702 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-090e559f-7c50-49ce-9602-95028088094c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:29.378434 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-090e559f-7c50-49ce-9602-95028088094c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:29.385531 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-090e559f-7c50-49ce-9602-95028088094c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:29.385986 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-090e559f-7c50-49ce-9602-95028088094c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:29.386783 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-090e559f-7c50-49ce-9602-95028088094c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:29.387215 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-090e559f-7c50-49ce-9602-95028088094c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:29.535014 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-090e559f-7c50-49ce-9602-95028088094c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:29.544221 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-090e559f-7c50-49ce-9602-95028088094c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:29.545736 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-090e559f-7c50-49ce-9602-95028088094c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:29.546974 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-090e559f-7c50-49ce-9602-95028088094c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1741 microversion: 2.20 time: 0.173316 Nov 21 13:54:29.547714 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 233/454] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:29 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:29.773872 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-3233ea0d-0838-40ab-ba57-88233d0f2802 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:29.774483 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-3233ea0d-0838-40ab-ba57-88233d0f2802 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:29.780896 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3233ea0d-0838-40ab-ba57-88233d0f2802 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:29.781345 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3233ea0d-0838-40ab-ba57-88233d0f2802 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:29.782394 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3233ea0d-0838-40ab-ba57-88233d0f2802 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:29.783065 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3233ea0d-0838-40ab-ba57-88233d0f2802 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:29.929530 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-3233ea0d-0838-40ab-ba57-88233d0f2802 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:29.937829 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-3233ea0d-0838-40ab-ba57-88233d0f2802 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.168321 Nov 21 13:54:29.938478 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 222/455] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:29 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:30.566396 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-1e6fd19b-e9f0-4793-b332-1b74a4d2b203 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:30.568182 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-1e6fd19b-e9f0-4793-b332-1b74a4d2b203 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:30.574259 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1e6fd19b-e9f0-4793-b332-1b74a4d2b203 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:30.574826 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1e6fd19b-e9f0-4793-b332-1b74a4d2b203 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:30.575713 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1e6fd19b-e9f0-4793-b332-1b74a4d2b203 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:30.576302 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1e6fd19b-e9f0-4793-b332-1b74a4d2b203 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:30.743214 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-1e6fd19b-e9f0-4793-b332-1b74a4d2b203 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:30.754289 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-1e6fd19b-e9f0-4793-b332-1b74a4d2b203 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:30.756426 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-1e6fd19b-e9f0-4793-b332-1b74a4d2b203 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:30.757693 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-1e6fd19b-e9f0-4793-b332-1b74a4d2b203 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1741 microversion: 2.20 time: 0.195542 Nov 21 13:54:30.758253 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 234/456] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:30 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:30.954283 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-b7affd1c-74c2-492e-9e13-74e8880ba494 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:30.954897 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-b7affd1c-74c2-492e-9e13-74e8880ba494 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:30.961350 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b7affd1c-74c2-492e-9e13-74e8880ba494 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:30.961803 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b7affd1c-74c2-492e-9e13-74e8880ba494 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:30.962767 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b7affd1c-74c2-492e-9e13-74e8880ba494 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:30.963363 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b7affd1c-74c2-492e-9e13-74e8880ba494 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:31.107679 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-b7affd1c-74c2-492e-9e13-74e8880ba494 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:31.116893 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-b7affd1c-74c2-492e-9e13-74e8880ba494 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.166201 Nov 21 13:54:31.117769 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 223/457] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:30 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:31.776529 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ec70cf9b-cef2-48b5-8337-a44ce2e03833 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:31.777279 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ec70cf9b-cef2-48b5-8337-a44ce2e03833 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:31.789697 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ec70cf9b-cef2-48b5-8337-a44ce2e03833 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:31.790431 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ec70cf9b-cef2-48b5-8337-a44ce2e03833 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:31.791510 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ec70cf9b-cef2-48b5-8337-a44ce2e03833 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:31.792242 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ec70cf9b-cef2-48b5-8337-a44ce2e03833 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:31.976979 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-ec70cf9b-cef2-48b5-8337-a44ce2e03833 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:31.985725 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-ec70cf9b-cef2-48b5-8337-a44ce2e03833 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:31.987676 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-ec70cf9b-cef2-48b5-8337-a44ce2e03833 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:31.989086 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ec70cf9b-cef2-48b5-8337-a44ce2e03833 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1741 microversion: 2.20 time: 0.216294 Nov 21 13:54:31.990248 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 235/458] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:31 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1741 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:32.134616 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-9a48d81b-fb32-4370-a821-9d991277b439 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:32.135827 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-9a48d81b-fb32-4370-a821-9d991277b439 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:32.144231 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9a48d81b-fb32-4370-a821-9d991277b439 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:32.144691 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9a48d81b-fb32-4370-a821-9d991277b439 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:32.146059 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9a48d81b-fb32-4370-a821-9d991277b439 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:32.146501 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9a48d81b-fb32-4370-a821-9d991277b439 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:32.311688 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-9a48d81b-fb32-4370-a821-9d991277b439 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:32.320139 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-9a48d81b-fb32-4370-a821-9d991277b439 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.189297 Nov 21 13:54:32.321163 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 224/459] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:32 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:33.009367 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b633e934-efb9-4207-a71f-b8760973fb6f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:33.010147 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b633e934-efb9-4207-a71f-b8760973fb6f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:33.024218 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b633e934-efb9-4207-a71f-b8760973fb6f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:33.024773 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b633e934-efb9-4207-a71f-b8760973fb6f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:33.025985 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b633e934-efb9-4207-a71f-b8760973fb6f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:33.026873 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b633e934-efb9-4207-a71f-b8760973fb6f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:33.213265 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-b633e934-efb9-4207-a71f-b8760973fb6f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:33.226570 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-b633e934-efb9-4207-a71f-b8760973fb6f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:33.228247 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-b633e934-efb9-4207-a71f-b8760973fb6f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:33.229470 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-b633e934-efb9-4207-a71f-b8760973fb6f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1741 microversion: 2.20 time: 0.224915 Nov 21 13:54:33.230039 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 236/460] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:33 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1741 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:33.339566 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-1c836699-30e0-4e66-91aa-2cbb2153a792 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:33.341220 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-1c836699-30e0-4e66-91aa-2cbb2153a792 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:33.349308 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1c836699-30e0-4e66-91aa-2cbb2153a792 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:33.349832 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1c836699-30e0-4e66-91aa-2cbb2153a792 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:33.350658 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1c836699-30e0-4e66-91aa-2cbb2153a792 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:33.351095 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1c836699-30e0-4e66-91aa-2cbb2153a792 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:33.498812 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-1c836699-30e0-4e66-91aa-2cbb2153a792 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:33.507204 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-1c836699-30e0-4e66-91aa-2cbb2153a792 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.172920 Nov 21 13:54:33.507772 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 225/461] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:33 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:34.249308 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-cce52a88-c92d-4e68-9005-e79ffba09a5e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:34.249951 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-cce52a88-c92d-4e68-9005-e79ffba09a5e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:34.256991 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cce52a88-c92d-4e68-9005-e79ffba09a5e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:34.257473 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cce52a88-c92d-4e68-9005-e79ffba09a5e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:34.258249 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cce52a88-c92d-4e68-9005-e79ffba09a5e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:34.258680 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cce52a88-c92d-4e68-9005-e79ffba09a5e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:34.391500 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-cce52a88-c92d-4e68-9005-e79ffba09a5e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:34.400484 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-cce52a88-c92d-4e68-9005-e79ffba09a5e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:34.401976 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-cce52a88-c92d-4e68-9005-e79ffba09a5e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:34.403171 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-cce52a88-c92d-4e68-9005-e79ffba09a5e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1741 microversion: 2.20 time: 0.157526 Nov 21 13:54:34.403727 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 237/462] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:34 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:34.525480 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-91b0dcf4-4abc-4748-90c5-6e8b00240646 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:34.526084 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-91b0dcf4-4abc-4748-90c5-6e8b00240646 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:34.532356 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-91b0dcf4-4abc-4748-90c5-6e8b00240646 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:34.532800 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-91b0dcf4-4abc-4748-90c5-6e8b00240646 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:34.533575 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-91b0dcf4-4abc-4748-90c5-6e8b00240646 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:34.534010 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-91b0dcf4-4abc-4748-90c5-6e8b00240646 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:34.700798 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-91b0dcf4-4abc-4748-90c5-6e8b00240646 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:34.708853 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-91b0dcf4-4abc-4748-90c5-6e8b00240646 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.187004 Nov 21 13:54:34.709611 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 226/463] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:34 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:35.420643 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-220750f8-9ded-407f-b2ff-7fa22d64b443 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:35.421243 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-220750f8-9ded-407f-b2ff-7fa22d64b443 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:35.427629 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-220750f8-9ded-407f-b2ff-7fa22d64b443 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:35.428101 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-220750f8-9ded-407f-b2ff-7fa22d64b443 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:35.428870 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-220750f8-9ded-407f-b2ff-7fa22d64b443 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:35.429304 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-220750f8-9ded-407f-b2ff-7fa22d64b443 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:35.557801 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-220750f8-9ded-407f-b2ff-7fa22d64b443 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:35.565440 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-220750f8-9ded-407f-b2ff-7fa22d64b443 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:35.566937 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-220750f8-9ded-407f-b2ff-7fa22d64b443 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:35.568649 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-220750f8-9ded-407f-b2ff-7fa22d64b443 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1723 microversion: 2.20 time: 0.151612 Nov 21 13:54:35.569205 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 238/464] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:35 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:35.725833 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-031e570a-d7a8-40ab-8b0a-55cc561a0219 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:35.726491 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-031e570a-d7a8-40ab-8b0a-55cc561a0219 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:35.732736 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-031e570a-d7a8-40ab-8b0a-55cc561a0219 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:35.733206 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-031e570a-d7a8-40ab-8b0a-55cc561a0219 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:35.733967 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-031e570a-d7a8-40ab-8b0a-55cc561a0219 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:35.734403 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-031e570a-d7a8-40ab-8b0a-55cc561a0219 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:35.873403 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-031e570a-d7a8-40ab-8b0a-55cc561a0219 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:35.882430 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-031e570a-d7a8-40ab-8b0a-55cc561a0219 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.160215 Nov 21 13:54:35.883006 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 227/465] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:35 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:36.586772 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-3d9cbcfc-d9c3-4dff-a854-1141dbd5a7dd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:36.587382 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3d9cbcfc-d9c3-4dff-a854-1141dbd5a7dd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:36.593613 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3d9cbcfc-d9c3-4dff-a854-1141dbd5a7dd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:36.594063 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3d9cbcfc-d9c3-4dff-a854-1141dbd5a7dd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:36.594845 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3d9cbcfc-d9c3-4dff-a854-1141dbd5a7dd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:36.595289 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3d9cbcfc-d9c3-4dff-a854-1141dbd5a7dd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:36.728991 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-3d9cbcfc-d9c3-4dff-a854-1141dbd5a7dd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:36.737068 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-3d9cbcfc-d9c3-4dff-a854-1141dbd5a7dd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:36.738570 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-3d9cbcfc-d9c3-4dff-a854-1141dbd5a7dd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:36.740308 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-3d9cbcfc-d9c3-4dff-a854-1141dbd5a7dd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1723 microversion: 2.20 time: 0.157197 Nov 21 13:54:36.740888 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 239/466] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:36 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:36.898196 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-f8d67541-479a-4b1b-ac01-aa399858750b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:36.898959 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-f8d67541-479a-4b1b-ac01-aa399858750b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:36.905367 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f8d67541-479a-4b1b-ac01-aa399858750b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:36.905816 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f8d67541-479a-4b1b-ac01-aa399858750b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:36.906585 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f8d67541-479a-4b1b-ac01-aa399858750b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:36.907021 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f8d67541-479a-4b1b-ac01-aa399858750b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:37.047340 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-f8d67541-479a-4b1b-ac01-aa399858750b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:37.055732 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-f8d67541-479a-4b1b-ac01-aa399858750b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.161258 Nov 21 13:54:37.056329 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 228/467] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:36 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:37.759365 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-3fe49014-d78b-4ac4-acf5-c42098d868aa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:37.759998 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3fe49014-d78b-4ac4-acf5-c42098d868aa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:37.766216 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3fe49014-d78b-4ac4-acf5-c42098d868aa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:37.766662 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3fe49014-d78b-4ac4-acf5-c42098d868aa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:37.767438 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3fe49014-d78b-4ac4-acf5-c42098d868aa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:37.767893 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3fe49014-d78b-4ac4-acf5-c42098d868aa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:37.897638 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-3fe49014-d78b-4ac4-acf5-c42098d868aa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:37.907482 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-3fe49014-d78b-4ac4-acf5-c42098d868aa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:37.909265 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-3fe49014-d78b-4ac4-acf5-c42098d868aa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:37.910562 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-3fe49014-d78b-4ac4-acf5-c42098d868aa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1666 microversion: 2.20 time: 0.155020 Nov 21 13:54:37.911445 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 240/468] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:37 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1666 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:37.928705 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-197ffa6a-36b4-4669-ac72-c8c036f58e25 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "006ee4ac-afbc-43ee-a3e9-7c1792bda56e"}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:54:37.929937 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-197ffa6a-36b4-4669-ac72-c8c036f58e25 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:37.936581 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-197ffa6a-36b4-4669-ac72-c8c036f58e25 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:37.937136 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-197ffa6a-36b4-4669-ac72-c8c036f58e25 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:37.937998 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-197ffa6a-36b4-4669-ac72-c8c036f58e25 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:37.938503 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-197ffa6a-36b4-4669-ac72-c8c036f58e25 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:38.072851 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-326bf4fe-0f07-4ba3-8120-69c836ff2988 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:38.073475 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-326bf4fe-0f07-4ba3-8120-69c836ff2988 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:38.081196 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-326bf4fe-0f07-4ba3-8120-69c836ff2988 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:38.081658 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-326bf4fe-0f07-4ba3-8120-69c836ff2988 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:38.082458 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-326bf4fe-0f07-4ba3-8120-69c836ff2988 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:38.082938 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-326bf4fe-0f07-4ba3-8120-69c836ff2988 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:38.230893 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-326bf4fe-0f07-4ba3-8120-69c836ff2988 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:38.238729 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-326bf4fe-0f07-4ba3-8120-69c836ff2988 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.169973 Nov 21 13:54:38.239864 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 241/469] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:38 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:54:38.244393 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-a52e18cb-4a12-4aa5-ad3f-d8be47b55b23 req-d1a6cfb4-c773-4f09-9067-c3e921e08e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e92c59-3be1-41c7-8ea1-b1bb65cf39c1", "name": "network-vif-unplugged", "status": "completed", "tag": "627d561d-d2ff-449e-a99f-9e5e3fd874ba"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:54:38.246160 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:54:38.246160 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:54:38.253121 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-a52e18cb-4a12-4aa5-ad3f-d8be47b55b23 req-d1a6cfb4-c773-4f09-9067-c3e921e08e05 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:38.253634 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-a52e18cb-4a12-4aa5-ad3f-d8be47b55b23 req-d1a6cfb4-c773-4f09-9067-c3e921e08e05 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:38.265887 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.compute.server_external_events [req-a52e18cb-4a12-4aa5-ad3f-d8be47b55b23 req-d1a6cfb4-c773-4f09-9067-c3e921e08e05 service nova] Unable to find a host for instance 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1. Dropping event network-vif-unplugged {{(pid=122564) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 21 13:54:38.266793 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-a52e18cb-4a12-4aa5-ad3f-d8be47b55b23 req-d1a6cfb4-c773-4f09-9067-c3e921e08e05 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025816 Nov 21 13:54:38.272704 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 242/470] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:54:38 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 21 13:54:38.302384 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-197ffa6a-36b4-4669-ac72-c8c036f58e25 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.376906 Nov 21 13:54:38.303001 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 229/471] 10.222.0.11 () {62 vars in 1363 bytes} [Sun Nov 21 13:54:37 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments => generated 188 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:54:38.423409 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-844635e9-54fa-4d15-8ec2-20d01327f82b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:54:38.424034 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-844635e9-54fa-4d15-8ec2-20d01327f82b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:38.430981 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-844635e9-54fa-4d15-8ec2-20d01327f82b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:38.431654 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-844635e9-54fa-4d15-8ec2-20d01327f82b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:38.432577 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-844635e9-54fa-4d15-8ec2-20d01327f82b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:38.433037 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-844635e9-54fa-4d15-8ec2-20d01327f82b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:38.523496 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-844635e9-54fa-4d15-8ec2-20d01327f82b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action" status: 202 len: 0 microversion: 2.20 time: 0.103444 Nov 21 13:54:38.524078 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 243/472] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:54:38 2021] POST /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 21 13:54:38.532082 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-40beb237-45b2-4161-ba79-1e37ca15e653 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:38.532688 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-40beb237-45b2-4161-ba79-1e37ca15e653 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:38.539712 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-40beb237-45b2-4161-ba79-1e37ca15e653 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:38.540191 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-40beb237-45b2-4161-ba79-1e37ca15e653 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:38.540963 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-40beb237-45b2-4161-ba79-1e37ca15e653 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:38.541394 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-40beb237-45b2-4161-ba79-1e37ca15e653 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:38.680158 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-40beb237-45b2-4161-ba79-1e37ca15e653 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:38.689025 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-40beb237-45b2-4161-ba79-1e37ca15e653 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:38.690783 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-40beb237-45b2-4161-ba79-1e37ca15e653 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:38.692018 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-40beb237-45b2-4161-ba79-1e37ca15e653 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1752 microversion: 2.20 time: 0.163609 Nov 21 13:54:38.692576 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 230/473] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:38 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:39.256895 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-1ee25615-cfa9-45a9-8d1a-9910947c99ab tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:39.257505 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-1ee25615-cfa9-45a9-8d1a-9910947c99ab tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:39.263742 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1ee25615-cfa9-45a9-8d1a-9910947c99ab tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:39.264239 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1ee25615-cfa9-45a9-8d1a-9910947c99ab tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:39.265021 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1ee25615-cfa9-45a9-8d1a-9910947c99ab tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:39.265457 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1ee25615-cfa9-45a9-8d1a-9910947c99ab tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:39.408087 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-1ee25615-cfa9-45a9-8d1a-9910947c99ab tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:39.418029 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-1ee25615-cfa9-45a9-8d1a-9910947c99ab tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.165256 Nov 21 13:54:39.418602 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 244/474] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:39 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:39.711253 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a8aa1857-a6cc-4cf6-bd6f-8205ad945bfc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:39.712212 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a8aa1857-a6cc-4cf6-bd6f-8205ad945bfc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:39.719335 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a8aa1857-a6cc-4cf6-bd6f-8205ad945bfc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:39.719849 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a8aa1857-a6cc-4cf6-bd6f-8205ad945bfc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:39.720881 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a8aa1857-a6cc-4cf6-bd6f-8205ad945bfc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:39.721314 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a8aa1857-a6cc-4cf6-bd6f-8205ad945bfc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:39.859012 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a8aa1857-a6cc-4cf6-bd6f-8205ad945bfc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:39.867855 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a8aa1857-a6cc-4cf6-bd6f-8205ad945bfc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:39.869310 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a8aa1857-a6cc-4cf6-bd6f-8205ad945bfc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:39.870454 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a8aa1857-a6cc-4cf6-bd6f-8205ad945bfc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1754 microversion: 2.20 time: 0.163594 Nov 21 13:54:39.871046 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 231/475] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:39 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:40.434288 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-271309ab-8b4c-4db5-930e-4e214474b168 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:40.434824 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-271309ab-8b4c-4db5-930e-4e214474b168 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:40.441078 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-271309ab-8b4c-4db5-930e-4e214474b168 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:40.441534 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-271309ab-8b4c-4db5-930e-4e214474b168 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:40.442905 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-271309ab-8b4c-4db5-930e-4e214474b168 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:40.443344 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-271309ab-8b4c-4db5-930e-4e214474b168 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:40.581273 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-271309ab-8b4c-4db5-930e-4e214474b168 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:40.589314 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-271309ab-8b4c-4db5-930e-4e214474b168 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.158751 Nov 21 13:54:40.589899 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 245/476] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:40 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:40.889376 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-716e3a29-a40d-48ba-b20c-b7d4a4a4642d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:40.890161 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-716e3a29-a40d-48ba-b20c-b7d4a4a4642d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:40.896720 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-716e3a29-a40d-48ba-b20c-b7d4a4a4642d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:40.897298 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-716e3a29-a40d-48ba-b20c-b7d4a4a4642d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:40.898557 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-716e3a29-a40d-48ba-b20c-b7d4a4a4642d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:40.898699 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-716e3a29-a40d-48ba-b20c-b7d4a4a4642d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:41.106690 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-716e3a29-a40d-48ba-b20c-b7d4a4a4642d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:41.115227 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-716e3a29-a40d-48ba-b20c-b7d4a4a4642d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:41.117602 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-716e3a29-a40d-48ba-b20c-b7d4a4a4642d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:41.118759 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-716e3a29-a40d-48ba-b20c-b7d4a4a4642d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.233226 Nov 21 13:54:41.119311 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 232/477] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:40 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:41.607301 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-9d7458df-a9f4-4bec-8dc9-70e7dd49e644 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:41.608330 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-9d7458df-a9f4-4bec-8dc9-70e7dd49e644 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:41.624206 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9d7458df-a9f4-4bec-8dc9-70e7dd49e644 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:41.624937 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9d7458df-a9f4-4bec-8dc9-70e7dd49e644 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:41.626231 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9d7458df-a9f4-4bec-8dc9-70e7dd49e644 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:41.627355 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9d7458df-a9f4-4bec-8dc9-70e7dd49e644 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:41.818925 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-9d7458df-a9f4-4bec-8dc9-70e7dd49e644 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:41.827799 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-9d7458df-a9f4-4bec-8dc9-70e7dd49e644 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.224933 Nov 21 13:54:41.828651 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 246/478] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:41 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:42.136952 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-f3d8004c-c13b-4d93-a286-bcdc0e58b2c2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:42.137554 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-f3d8004c-c13b-4d93-a286-bcdc0e58b2c2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:42.143676 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f3d8004c-c13b-4d93-a286-bcdc0e58b2c2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:42.144156 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f3d8004c-c13b-4d93-a286-bcdc0e58b2c2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:42.144924 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f3d8004c-c13b-4d93-a286-bcdc0e58b2c2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:42.145859 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f3d8004c-c13b-4d93-a286-bcdc0e58b2c2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:42.296531 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-f3d8004c-c13b-4d93-a286-bcdc0e58b2c2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:42.305327 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-f3d8004c-c13b-4d93-a286-bcdc0e58b2c2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:42.307062 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-f3d8004c-c13b-4d93-a286-bcdc0e58b2c2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:42.308287 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-f3d8004c-c13b-4d93-a286-bcdc0e58b2c2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.174972 Nov 21 13:54:42.308833 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 233/479] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:42 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:42.845955 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-43e500c2-3d29-4822-b2af-930bfaf7ca43 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:42.846556 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-43e500c2-3d29-4822-b2af-930bfaf7ca43 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:42.852658 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-43e500c2-3d29-4822-b2af-930bfaf7ca43 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:42.853110 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-43e500c2-3d29-4822-b2af-930bfaf7ca43 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:42.853894 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-43e500c2-3d29-4822-b2af-930bfaf7ca43 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:42.854342 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-43e500c2-3d29-4822-b2af-930bfaf7ca43 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:43.015890 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-43e500c2-3d29-4822-b2af-930bfaf7ca43 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:43.025902 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-43e500c2-3d29-4822-b2af-930bfaf7ca43 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.183886 Nov 21 13:54:43.026443 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 247/480] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:42 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:43.328067 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ee1a91cb-5737-4286-b7b3-ad1e5c3511a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:43.328768 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ee1a91cb-5737-4286-b7b3-ad1e5c3511a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:43.336213 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ee1a91cb-5737-4286-b7b3-ad1e5c3511a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:43.336672 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ee1a91cb-5737-4286-b7b3-ad1e5c3511a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:43.337550 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ee1a91cb-5737-4286-b7b3-ad1e5c3511a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:43.337992 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ee1a91cb-5737-4286-b7b3-ad1e5c3511a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:43.494122 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ee1a91cb-5737-4286-b7b3-ad1e5c3511a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:43.502711 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ee1a91cb-5737-4286-b7b3-ad1e5c3511a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:43.504417 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ee1a91cb-5737-4286-b7b3-ad1e5c3511a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:43.505857 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ee1a91cb-5737-4286-b7b3-ad1e5c3511a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.182050 Nov 21 13:54:43.506631 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 234/481] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:43 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:44.046257 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-5adacf4b-9d51-400b-843c-3ed4fb162324 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:44.046991 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-5adacf4b-9d51-400b-843c-3ed4fb162324 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:44.055057 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5adacf4b-9d51-400b-843c-3ed4fb162324 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:44.055513 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5adacf4b-9d51-400b-843c-3ed4fb162324 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:44.056333 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5adacf4b-9d51-400b-843c-3ed4fb162324 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:44.056765 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5adacf4b-9d51-400b-843c-3ed4fb162324 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:44.201542 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-5adacf4b-9d51-400b-843c-3ed4fb162324 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:44.209797 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-5adacf4b-9d51-400b-843c-3ed4fb162324 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.168150 Nov 21 13:54:44.210653 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 248/482] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:44 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:44.524107 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-8301989a-17e5-47bf-8716-da08570bf14d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:44.524858 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-8301989a-17e5-47bf-8716-da08570bf14d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:44.532040 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8301989a-17e5-47bf-8716-da08570bf14d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:44.532488 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8301989a-17e5-47bf-8716-da08570bf14d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:44.533665 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8301989a-17e5-47bf-8716-da08570bf14d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:44.534477 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8301989a-17e5-47bf-8716-da08570bf14d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:44.693351 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-8301989a-17e5-47bf-8716-da08570bf14d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:44.702155 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-8301989a-17e5-47bf-8716-da08570bf14d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:44.703816 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-8301989a-17e5-47bf-8716-da08570bf14d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:44.705046 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-8301989a-17e5-47bf-8716-da08570bf14d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.184888 Nov 21 13:54:44.705720 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 235/483] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:44 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:45.226345 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-cedb2c7f-251d-4f66-a76e-ab756fa06f93 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:45.227257 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-cedb2c7f-251d-4f66-a76e-ab756fa06f93 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:45.233825 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cedb2c7f-251d-4f66-a76e-ab756fa06f93 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:45.234359 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cedb2c7f-251d-4f66-a76e-ab756fa06f93 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:45.235350 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cedb2c7f-251d-4f66-a76e-ab756fa06f93 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:45.235893 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cedb2c7f-251d-4f66-a76e-ab756fa06f93 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:45.374248 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-cedb2c7f-251d-4f66-a76e-ab756fa06f93 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:45.383315 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-cedb2c7f-251d-4f66-a76e-ab756fa06f93 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.160665 Nov 21 13:54:45.384329 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 249/484] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:45 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:45.723573 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-8037cdc2-20f8-4573-8e64-468caf5c9ca5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:45.724214 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-8037cdc2-20f8-4573-8e64-468caf5c9ca5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:45.730509 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8037cdc2-20f8-4573-8e64-468caf5c9ca5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:45.730962 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8037cdc2-20f8-4573-8e64-468caf5c9ca5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:45.731754 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8037cdc2-20f8-4573-8e64-468caf5c9ca5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:45.732215 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8037cdc2-20f8-4573-8e64-468caf5c9ca5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:45.872821 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-8037cdc2-20f8-4573-8e64-468caf5c9ca5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:45.883889 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-8037cdc2-20f8-4573-8e64-468caf5c9ca5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:45.885405 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-8037cdc2-20f8-4573-8e64-468caf5c9ca5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:45.886578 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-8037cdc2-20f8-4573-8e64-468caf5c9ca5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.166762 Nov 21 13:54:45.887137 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 236/485] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:45 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:46.402406 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-da1b8f57-fe3c-4885-b8d7-d98413efb0c7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:46.403031 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-da1b8f57-fe3c-4885-b8d7-d98413efb0c7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:46.409389 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-da1b8f57-fe3c-4885-b8d7-d98413efb0c7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:46.409841 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-da1b8f57-fe3c-4885-b8d7-d98413efb0c7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:46.411248 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-da1b8f57-fe3c-4885-b8d7-d98413efb0c7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:46.411701 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-da1b8f57-fe3c-4885-b8d7-d98413efb0c7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:46.549396 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-da1b8f57-fe3c-4885-b8d7-d98413efb0c7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:46.563732 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-da1b8f57-fe3c-4885-b8d7-d98413efb0c7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.165029 Nov 21 13:54:46.566417 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 250/486] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:46 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:46.904756 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-cd5d3730-fb19-47c0-9317-5accb11581f0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:46.905609 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-cd5d3730-fb19-47c0-9317-5accb11581f0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:46.912411 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cd5d3730-fb19-47c0-9317-5accb11581f0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:46.912863 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cd5d3730-fb19-47c0-9317-5accb11581f0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:46.913644 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cd5d3730-fb19-47c0-9317-5accb11581f0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:46.914077 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cd5d3730-fb19-47c0-9317-5accb11581f0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:47.103842 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-cd5d3730-fb19-47c0-9317-5accb11581f0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:47.113393 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-cd5d3730-fb19-47c0-9317-5accb11581f0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:47.116251 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-cd5d3730-fb19-47c0-9317-5accb11581f0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:47.117741 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-cd5d3730-fb19-47c0-9317-5accb11581f0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.216669 Nov 21 13:54:47.118434 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 237/487] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:46 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:47.582106 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ba830f07-eb1c-45dc-b956-7922362aa2e5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:47.582931 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ba830f07-eb1c-45dc-b956-7922362aa2e5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:47.589544 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ba830f07-eb1c-45dc-b956-7922362aa2e5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:47.590116 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ba830f07-eb1c-45dc-b956-7922362aa2e5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:47.590970 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ba830f07-eb1c-45dc-b956-7922362aa2e5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:47.591472 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ba830f07-eb1c-45dc-b956-7922362aa2e5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:47.760607 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-ba830f07-eb1c-45dc-b956-7922362aa2e5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:47.768556 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ba830f07-eb1c-45dc-b956-7922362aa2e5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.191016 Nov 21 13:54:47.769112 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 251/488] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:47 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:48.139255 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-bd49f4fe-aa2a-4d53-b358-729b9c08d1bf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:48.140597 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-bd49f4fe-aa2a-4d53-b358-729b9c08d1bf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:48.151611 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bd49f4fe-aa2a-4d53-b358-729b9c08d1bf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:48.152343 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bd49f4fe-aa2a-4d53-b358-729b9c08d1bf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:48.153619 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bd49f4fe-aa2a-4d53-b358-729b9c08d1bf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:48.154267 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bd49f4fe-aa2a-4d53-b358-729b9c08d1bf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:48.309144 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bd49f4fe-aa2a-4d53-b358-729b9c08d1bf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:48.317754 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bd49f4fe-aa2a-4d53-b358-729b9c08d1bf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:48.319253 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bd49f4fe-aa2a-4d53-b358-729b9c08d1bf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:48.320487 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-bd49f4fe-aa2a-4d53-b358-729b9c08d1bf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.185760 Nov 21 13:54:48.332793 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 238/489] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:48 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:48.785422 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-924ddb1f-f0c6-4ccb-bc7f-ea122bd1b176 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:48.786870 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-924ddb1f-f0c6-4ccb-bc7f-ea122bd1b176 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:48.793472 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-924ddb1f-f0c6-4ccb-bc7f-ea122bd1b176 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:48.794335 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-924ddb1f-f0c6-4ccb-bc7f-ea122bd1b176 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:48.795492 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-924ddb1f-f0c6-4ccb-bc7f-ea122bd1b176 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:48.796624 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-924ddb1f-f0c6-4ccb-bc7f-ea122bd1b176 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:48.932656 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-924ddb1f-f0c6-4ccb-bc7f-ea122bd1b176 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:48.940578 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-924ddb1f-f0c6-4ccb-bc7f-ea122bd1b176 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.158828 Nov 21 13:54:48.941161 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 252/490] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:48 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:49.338739 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-b6a8dc74-511f-4538-b9bd-4c6f0c191d75 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:49.339357 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-b6a8dc74-511f-4538-b9bd-4c6f0c191d75 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:49.345583 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b6a8dc74-511f-4538-b9bd-4c6f0c191d75 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:49.346022 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b6a8dc74-511f-4538-b9bd-4c6f0c191d75 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:49.346787 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b6a8dc74-511f-4538-b9bd-4c6f0c191d75 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:49.347214 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b6a8dc74-511f-4538-b9bd-4c6f0c191d75 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:49.491772 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-b6a8dc74-511f-4538-b9bd-4c6f0c191d75 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:49.500263 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-b6a8dc74-511f-4538-b9bd-4c6f0c191d75 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:49.502045 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-b6a8dc74-511f-4538-b9bd-4c6f0c191d75 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:49.503200 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-b6a8dc74-511f-4538-b9bd-4c6f0c191d75 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.168218 Nov 21 13:54:49.503750 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 239/491] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:49 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:49.957495 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-cf235089-29eb-48cf-8fb9-8b32dd05094a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:49.958151 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-cf235089-29eb-48cf-8fb9-8b32dd05094a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:49.964302 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cf235089-29eb-48cf-8fb9-8b32dd05094a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:49.964758 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cf235089-29eb-48cf-8fb9-8b32dd05094a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:49.965533 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cf235089-29eb-48cf-8fb9-8b32dd05094a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:49.965971 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cf235089-29eb-48cf-8fb9-8b32dd05094a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:50.106681 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-cf235089-29eb-48cf-8fb9-8b32dd05094a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:50.114356 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-cf235089-29eb-48cf-8fb9-8b32dd05094a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.160632 Nov 21 13:54:50.114924 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 253/492] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:49 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:50.523239 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-68f15827-6faa-4699-8543-46e72387bd67 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:50.523947 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-68f15827-6faa-4699-8543-46e72387bd67 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:50.530536 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-68f15827-6faa-4699-8543-46e72387bd67 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:50.530986 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-68f15827-6faa-4699-8543-46e72387bd67 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:50.531846 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-68f15827-6faa-4699-8543-46e72387bd67 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:50.532467 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-68f15827-6faa-4699-8543-46e72387bd67 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:50.670298 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-68f15827-6faa-4699-8543-46e72387bd67 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:50.678530 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-68f15827-6faa-4699-8543-46e72387bd67 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:50.680171 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-68f15827-6faa-4699-8543-46e72387bd67 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:50.681384 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-68f15827-6faa-4699-8543-46e72387bd67 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.162845 Nov 21 13:54:50.681944 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 240/493] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:50 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:51.132138 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-97cddd29-4d70-4487-aa24-18bfbbbdc4aa tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:51.132829 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-97cddd29-4d70-4487-aa24-18bfbbbdc4aa tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:51.140038 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-97cddd29-4d70-4487-aa24-18bfbbbdc4aa tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:51.140501 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-97cddd29-4d70-4487-aa24-18bfbbbdc4aa tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:51.141298 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-97cddd29-4d70-4487-aa24-18bfbbbdc4aa tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:51.141738 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-97cddd29-4d70-4487-aa24-18bfbbbdc4aa tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:51.293122 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-97cddd29-4d70-4487-aa24-18bfbbbdc4aa tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:51.302937 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-97cddd29-4d70-4487-aa24-18bfbbbdc4aa tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.175134 Nov 21 13:54:51.303754 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 254/494] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:51 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:51.699940 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-bc3f1385-e47e-4646-aace-094d172421b2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:51.700643 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-bc3f1385-e47e-4646-aace-094d172421b2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:51.717401 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bc3f1385-e47e-4646-aace-094d172421b2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:51.721508 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bc3f1385-e47e-4646-aace-094d172421b2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:51.722431 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bc3f1385-e47e-4646-aace-094d172421b2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:51.726033 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bc3f1385-e47e-4646-aace-094d172421b2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:51.862846 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bc3f1385-e47e-4646-aace-094d172421b2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:51.871308 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bc3f1385-e47e-4646-aace-094d172421b2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:51.872864 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bc3f1385-e47e-4646-aace-094d172421b2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:51.874058 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-bc3f1385-e47e-4646-aace-094d172421b2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.177832 Nov 21 13:54:51.874918 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 241/495] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:51 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:52.320616 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-031b1cb1-6b9f-45d4-82c7-3152da67cd85 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:52.321228 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-031b1cb1-6b9f-45d4-82c7-3152da67cd85 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:52.327400 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-031b1cb1-6b9f-45d4-82c7-3152da67cd85 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:52.327907 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-031b1cb1-6b9f-45d4-82c7-3152da67cd85 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:52.328656 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-031b1cb1-6b9f-45d4-82c7-3152da67cd85 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:52.329102 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-031b1cb1-6b9f-45d4-82c7-3152da67cd85 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:52.469335 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-031b1cb1-6b9f-45d4-82c7-3152da67cd85 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:52.478783 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-031b1cb1-6b9f-45d4-82c7-3152da67cd85 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.162458 Nov 21 13:54:52.479827 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 255/496] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:52 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:52.892508 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-e318dbbf-0cea-45d1-99c0-f7184fad4911 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:52.893106 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-e318dbbf-0cea-45d1-99c0-f7184fad4911 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:52.899467 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e318dbbf-0cea-45d1-99c0-f7184fad4911 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:52.899968 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e318dbbf-0cea-45d1-99c0-f7184fad4911 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:52.900757 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e318dbbf-0cea-45d1-99c0-f7184fad4911 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:52.901210 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e318dbbf-0cea-45d1-99c0-f7184fad4911 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:53.035150 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-e318dbbf-0cea-45d1-99c0-f7184fad4911 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:53.044569 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-e318dbbf-0cea-45d1-99c0-f7184fad4911 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:53.046083 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-e318dbbf-0cea-45d1-99c0-f7184fad4911 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:53.047261 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-e318dbbf-0cea-45d1-99c0-f7184fad4911 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.158417 Nov 21 13:54:53.048947 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 242/497] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:52 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:53.495538 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-039fbbc2-507b-48f4-8c65-9eb725e87811 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:53.496182 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-039fbbc2-507b-48f4-8c65-9eb725e87811 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:53.502648 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-039fbbc2-507b-48f4-8c65-9eb725e87811 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:53.503124 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-039fbbc2-507b-48f4-8c65-9eb725e87811 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:53.503949 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-039fbbc2-507b-48f4-8c65-9eb725e87811 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:53.504887 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-039fbbc2-507b-48f4-8c65-9eb725e87811 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:53.637931 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-039fbbc2-507b-48f4-8c65-9eb725e87811 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:53.646359 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-039fbbc2-507b-48f4-8c65-9eb725e87811 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.154668 Nov 21 13:54:53.646918 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 256/498] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:53 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:54.066613 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a292cd5c-9a33-4236-a06c-4165c32e7379 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:54.067975 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a292cd5c-9a33-4236-a06c-4165c32e7379 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:54.074213 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a292cd5c-9a33-4236-a06c-4165c32e7379 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:54.074665 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a292cd5c-9a33-4236-a06c-4165c32e7379 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:54.075448 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a292cd5c-9a33-4236-a06c-4165c32e7379 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:54.075922 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a292cd5c-9a33-4236-a06c-4165c32e7379 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:54.213445 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a292cd5c-9a33-4236-a06c-4165c32e7379 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:54.221520 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a292cd5c-9a33-4236-a06c-4165c32e7379 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:54.223605 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a292cd5c-9a33-4236-a06c-4165c32e7379 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:54.224767 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a292cd5c-9a33-4236-a06c-4165c32e7379 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.162298 Nov 21 13:54:54.225321 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 243/499] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:54 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:54.662966 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-5b9b26f2-99e9-4e97-8f20-e38d39d25f6d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:54.663588 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-5b9b26f2-99e9-4e97-8f20-e38d39d25f6d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:54.669915 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5b9b26f2-99e9-4e97-8f20-e38d39d25f6d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:54.670373 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5b9b26f2-99e9-4e97-8f20-e38d39d25f6d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:54.671157 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5b9b26f2-99e9-4e97-8f20-e38d39d25f6d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:54.671610 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5b9b26f2-99e9-4e97-8f20-e38d39d25f6d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:54.805406 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-5b9b26f2-99e9-4e97-8f20-e38d39d25f6d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:54.814110 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-5b9b26f2-99e9-4e97-8f20-e38d39d25f6d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1567 microversion: 2.1 time: 0.155529 Nov 21 13:54:54.814668 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 257/500] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:54 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:55.243120 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ca7875a0-d4d1-454d-b658-2aff61f33ae3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:55.244182 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ca7875a0-d4d1-454d-b658-2aff61f33ae3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:55.251048 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ca7875a0-d4d1-454d-b658-2aff61f33ae3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:55.251732 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ca7875a0-d4d1-454d-b658-2aff61f33ae3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:55.252541 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ca7875a0-d4d1-454d-b658-2aff61f33ae3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:55.252970 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ca7875a0-d4d1-454d-b658-2aff61f33ae3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:55.410923 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ca7875a0-d4d1-454d-b658-2aff61f33ae3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:55.419159 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ca7875a0-d4d1-454d-b658-2aff61f33ae3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:55.421027 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ca7875a0-d4d1-454d-b658-2aff61f33ae3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:55.422170 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ca7875a0-d4d1-454d-b658-2aff61f33ae3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.183634 Nov 21 13:54:55.422715 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 244/501] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:55 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 13:54:55.830282 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-eefecec9-cebf-4a84-a7b7-b1b5d3834094 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:55.830893 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-eefecec9-cebf-4a84-a7b7-b1b5d3834094 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:55.837858 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-eefecec9-cebf-4a84-a7b7-b1b5d3834094 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:55.838311 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-eefecec9-cebf-4a84-a7b7-b1b5d3834094 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:55.839087 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-eefecec9-cebf-4a84-a7b7-b1b5d3834094 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:55.839526 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-eefecec9-cebf-4a84-a7b7-b1b5d3834094 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:55.967686 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-eefecec9-cebf-4a84-a7b7-b1b5d3834094 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:55.976119 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-eefecec9-cebf-4a84-a7b7-b1b5d3834094 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1547 microversion: 2.1 time: 0.149508 Nov 21 13:54:55.976699 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 258/502] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:55 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:55.998302 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-972f27fd-b112-4e15-9773-e91bfa3732bc tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:55.998787 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-972f27fd-b112-4e15-9773-e91bfa3732bc tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:56.005443 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-972f27fd-b112-4e15-9773-e91bfa3732bc tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:56.005884 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-972f27fd-b112-4e15-9773-e91bfa3732bc tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:56.006648 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-972f27fd-b112-4e15-9773-e91bfa3732bc tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:56.007078 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-972f27fd-b112-4e15-9773-e91bfa3732bc tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:56.126399 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-972f27fd-b112-4e15-9773-e91bfa3732bc tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] HTTP exception thrown: Cannot 'detach_volume' instance 2d1c9d3d-f088-4d2f-b2bc-e26543509aae while it is in vm_state rescued Nov 21 13:54:56.127004 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-972f27fd-b112-4e15-9773-e91bfa3732bc tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Returning 409 to user: Cannot 'detach_volume' instance 2d1c9d3d-f088-4d2f-b2bc-e26543509aae while it is in vm_state rescued {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:54:56.127857 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-972f27fd-b112-4e15-9773-e91bfa3732bc tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "DELETE /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae/os-volume_attachments/f0f4d794-6871-48ad-9751-4c165027171b" status: 409 len: 152 microversion: 2.1 time: 0.133310 Nov 21 13:54:56.128403 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 245/503] 10.222.0.11 () {58 vars in 1415 bytes} [Sun Nov 21 13:54:55 2021] DELETE /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae/os-volume_attachments/f0f4d794-6871-48ad-9751-4c165027171b => generated 152 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 21 13:54:56.137111 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-e88e8cc5-5d53-4e9c-bc72-5aeef515d556 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:54:56.137643 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-e88e8cc5-5d53-4e9c-bc72-5aeef515d556 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:56.143244 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e88e8cc5-5d53-4e9c-bc72-5aeef515d556 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:56.143692 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e88e8cc5-5d53-4e9c-bc72-5aeef515d556 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:56.144496 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e88e8cc5-5d53-4e9c-bc72-5aeef515d556 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:56.144961 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e88e8cc5-5d53-4e9c-bc72-5aeef515d556 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:56.214595 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-e88e8cc5-5d53-4e9c-bc72-5aeef515d556 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "POST /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae/action" status: 202 len: 0 microversion: 2.1 time: 0.080613 Nov 21 13:54:56.218003 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 259/504] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:54:56 2021] POST /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:54:56.222821 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-0ed191a2-e63f-40ad-b8ba-54731279cf0a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:56.223443 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-0ed191a2-e63f-40ad-b8ba-54731279cf0a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:56.232582 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0ed191a2-e63f-40ad-b8ba-54731279cf0a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:56.233459 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0ed191a2-e63f-40ad-b8ba-54731279cf0a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:56.234336 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0ed191a2-e63f-40ad-b8ba-54731279cf0a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:56.234786 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0ed191a2-e63f-40ad-b8ba-54731279cf0a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:56.403167 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-0ed191a2-e63f-40ad-b8ba-54731279cf0a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:56.417873 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-0ed191a2-e63f-40ad-b8ba-54731279cf0a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1555 microversion: 2.1 time: 0.198564 Nov 21 13:54:56.419016 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 246/505] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:56 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1555 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:56.441910 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-764d0fb0-7644-420f-b108-3f19b3c18839 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:56.442526 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-764d0fb0-7644-420f-b108-3f19b3c18839 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:56.448878 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-764d0fb0-7644-420f-b108-3f19b3c18839 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:56.449311 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-764d0fb0-7644-420f-b108-3f19b3c18839 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:56.450283 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-764d0fb0-7644-420f-b108-3f19b3c18839 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:56.450715 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-764d0fb0-7644-420f-b108-3f19b3c18839 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:56.641735 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-764d0fb0-7644-420f-b108-3f19b3c18839 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:56.650846 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-764d0fb0-7644-420f-b108-3f19b3c18839 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:56.652593 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-764d0fb0-7644-420f-b108-3f19b3c18839 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:56.653846 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-764d0fb0-7644-420f-b108-3f19b3c18839 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.216146 Nov 21 13:54:56.654386 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 260/506] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:56 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 13:54:57.435960 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c71305d9-b94b-4c47-ac3f-22d30da12558 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:57.436575 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-c71305d9-b94b-4c47-ac3f-22d30da12558 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:57.442868 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c71305d9-b94b-4c47-ac3f-22d30da12558 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:57.443426 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c71305d9-b94b-4c47-ac3f-22d30da12558 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:57.444244 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c71305d9-b94b-4c47-ac3f-22d30da12558 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:57.444680 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c71305d9-b94b-4c47-ac3f-22d30da12558 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:57.587167 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-c71305d9-b94b-4c47-ac3f-22d30da12558 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:57.595475 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c71305d9-b94b-4c47-ac3f-22d30da12558 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1555 microversion: 2.1 time: 0.163245 Nov 21 13:54:57.596087 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 247/507] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:57 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:57.672577 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-803aeb5d-8669-4cc5-89c8-428c144725f7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:57.673185 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-803aeb5d-8669-4cc5-89c8-428c144725f7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:57.679412 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-803aeb5d-8669-4cc5-89c8-428c144725f7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:57.679904 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-803aeb5d-8669-4cc5-89c8-428c144725f7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:57.680859 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-803aeb5d-8669-4cc5-89c8-428c144725f7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:57.681298 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-803aeb5d-8669-4cc5-89c8-428c144725f7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:57.819239 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-803aeb5d-8669-4cc5-89c8-428c144725f7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:57.827389 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-803aeb5d-8669-4cc5-89c8-428c144725f7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:57.828951 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-803aeb5d-8669-4cc5-89c8-428c144725f7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:57.830109 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-803aeb5d-8669-4cc5-89c8-428c144725f7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.161249 Nov 21 13:54:57.830706 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 261/508] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:57 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:58.613095 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-6ca4976e-a545-4ce5-b6f6-14e256176156 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:58.614232 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-6ca4976e-a545-4ce5-b6f6-14e256176156 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:58.620679 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6ca4976e-a545-4ce5-b6f6-14e256176156 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:58.621390 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6ca4976e-a545-4ce5-b6f6-14e256176156 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:58.622361 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6ca4976e-a545-4ce5-b6f6-14e256176156 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:58.622789 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6ca4976e-a545-4ce5-b6f6-14e256176156 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:58.850069 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-9384d3af-f1b9-4e12-be1a-e0b882f4e62a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:58.851300 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-9384d3af-f1b9-4e12-be1a-e0b882f4e62a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:58.858470 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9384d3af-f1b9-4e12-be1a-e0b882f4e62a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:58.858927 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9384d3af-f1b9-4e12-be1a-e0b882f4e62a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:58.859741 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9384d3af-f1b9-4e12-be1a-e0b882f4e62a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:58.860203 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9384d3af-f1b9-4e12-be1a-e0b882f4e62a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:58.870814 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-6ca4976e-a545-4ce5-b6f6-14e256176156 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:58.880830 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-6ca4976e-a545-4ce5-b6f6-14e256176156 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1555 microversion: 2.1 time: 0.271343 Nov 21 13:54:58.891721 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 248/509] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:58 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1555 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:54:59.019120 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-9384d3af-f1b9-4e12-be1a-e0b882f4e62a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:59.043567 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-9384d3af-f1b9-4e12-be1a-e0b882f4e62a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:59.048751 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-9384d3af-f1b9-4e12-be1a-e0b882f4e62a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:54:59.049950 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-9384d3af-f1b9-4e12-be1a-e0b882f4e62a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.204629 Nov 21 13:54:59.050685 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 262/510] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:54:58 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:54:59.898253 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-efcb8818-0136-41f7-b80b-b4b14984702c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:54:59.898858 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-efcb8818-0136-41f7-b80b-b4b14984702c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:54:59.905470 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-efcb8818-0136-41f7-b80b-b4b14984702c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:59.905921 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-efcb8818-0136-41f7-b80b-b4b14984702c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:54:59.906703 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-efcb8818-0136-41f7-b80b-b4b14984702c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:54:59.907310 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-efcb8818-0136-41f7-b80b-b4b14984702c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:00.069434 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-51157728-df65-4865-8f13-8fe6104955a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:00.070739 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-51157728-df65-4865-8f13-8fe6104955a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:00.090322 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-51157728-df65-4865-8f13-8fe6104955a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:00.090789 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-51157728-df65-4865-8f13-8fe6104955a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:00.091633 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-51157728-df65-4865-8f13-8fe6104955a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:00.092132 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-51157728-df65-4865-8f13-8fe6104955a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:00.092346 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-efcb8818-0136-41f7-b80b-b4b14984702c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:00.105168 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-efcb8818-0136-41f7-b80b-b4b14984702c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1561 microversion: 2.1 time: 0.205499 Nov 21 13:55:00.116897 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 249/511] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:54:59 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1561 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:00.214787 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c152e916-cc71-4b4a-9cf6-60e081156be8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:00.215593 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-c152e916-cc71-4b4a-9cf6-60e081156be8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:00.232198 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c152e916-cc71-4b4a-9cf6-60e081156be8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:00.232936 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c152e916-cc71-4b4a-9cf6-60e081156be8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:00.234762 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c152e916-cc71-4b4a-9cf6-60e081156be8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:00.235434 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c152e916-cc71-4b4a-9cf6-60e081156be8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:00.372353 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-51157728-df65-4865-8f13-8fe6104955a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:00.382362 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-51157728-df65-4865-8f13-8fe6104955a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:00.384142 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-51157728-df65-4865-8f13-8fe6104955a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:00.385606 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-51157728-df65-4865-8f13-8fe6104955a4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.320942 Nov 21 13:55:00.397820 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.objects.instance [None req-c152e916-cc71-4b4a-9cf6-60e081156be8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lazy-loading 'services' on Instance uuid 2d1c9d3d-f088-4d2f-b2bc-e26543509aae {{(pid=122565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:55:00.398250 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 263/512] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:55:00 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:55:00.562891 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c152e916-cc71-4b4a-9cf6-60e081156be8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "DELETE /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae/os-volume_attachments/f0f4d794-6871-48ad-9751-4c165027171b" status: 202 len: 0 microversion: 2.1 time: 0.352205 Nov 21 13:55:00.564100 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 250/513] 10.222.0.11 () {58 vars in 1415 bytes} [Sun Nov 21 13:55:00 2021] DELETE /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae/os-volume_attachments/f0f4d794-6871-48ad-9751-4c165027171b => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:55:00.572978 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-01ca8816-0357-42d5-8b8e-2b2a4372cce3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:00.574540 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-01ca8816-0357-42d5-8b8e-2b2a4372cce3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:00.584364 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-01ca8816-0357-42d5-8b8e-2b2a4372cce3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:00.585934 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-01ca8816-0357-42d5-8b8e-2b2a4372cce3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:00.587266 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-01ca8816-0357-42d5-8b8e-2b2a4372cce3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:00.588378 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-01ca8816-0357-42d5-8b8e-2b2a4372cce3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:00.632181 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-01ca8816-0357-42d5-8b8e-2b2a4372cce3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064022 Nov 21 13:55:00.633217 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 264/514] 10.222.0.11 () {58 vars in 1301 bytes} [Sun Nov 21 13:55:00 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:55:01.404666 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-4db91170-f1fc-4e58-ba34-4cb0d59de3cd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:01.406396 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-4db91170-f1fc-4e58-ba34-4cb0d59de3cd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:01.413834 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4db91170-f1fc-4e58-ba34-4cb0d59de3cd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:01.414857 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4db91170-f1fc-4e58-ba34-4cb0d59de3cd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:01.416559 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4db91170-f1fc-4e58-ba34-4cb0d59de3cd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:01.417221 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4db91170-f1fc-4e58-ba34-4cb0d59de3cd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:01.604822 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4db91170-f1fc-4e58-ba34-4cb0d59de3cd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:01.616126 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4db91170-f1fc-4e58-ba34-4cb0d59de3cd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:01.618227 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4db91170-f1fc-4e58-ba34-4cb0d59de3cd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:01.619670 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-4db91170-f1fc-4e58-ba34-4cb0d59de3cd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.219481 Nov 21 13:55:01.620887 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 251/515] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:55:01 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 13:55:01.644078 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-4a43c678-47f1-46cd-9162-c683a9f9eb48 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:01.645222 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-4a43c678-47f1-46cd-9162-c683a9f9eb48 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:01.652337 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4a43c678-47f1-46cd-9162-c683a9f9eb48 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:01.652992 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4a43c678-47f1-46cd-9162-c683a9f9eb48 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:01.653942 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4a43c678-47f1-46cd-9162-c683a9f9eb48 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:01.654796 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4a43c678-47f1-46cd-9162-c683a9f9eb48 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:01.691046 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-4a43c678-47f1-46cd-9162-c683a9f9eb48 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051019 Nov 21 13:55:01.691665 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 265/516] 10.222.0.11 () {58 vars in 1301 bytes} [Sun Nov 21 13:55:01 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 21 13:55:02.638935 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-4c2c62e2-ae6a-4ec5-bf93-774db4a624b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:02.639536 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-4c2c62e2-ae6a-4ec5-bf93-774db4a624b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:02.647269 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4c2c62e2-ae6a-4ec5-bf93-774db4a624b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:02.648014 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4c2c62e2-ae6a-4ec5-bf93-774db4a624b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:02.648866 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4c2c62e2-ae6a-4ec5-bf93-774db4a624b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:02.649384 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4c2c62e2-ae6a-4ec5-bf93-774db4a624b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:02.798946 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4c2c62e2-ae6a-4ec5-bf93-774db4a624b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:02.807826 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4c2c62e2-ae6a-4ec5-bf93-774db4a624b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:02.809460 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4c2c62e2-ae6a-4ec5-bf93-774db4a624b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:02.810743 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-4c2c62e2-ae6a-4ec5-bf93-774db4a624b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.176087 Nov 21 13:55:02.811211 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 252/517] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:55:02 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:55:03.829873 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-0c3004cf-178f-4e53-9796-dff342801eef tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:03.830664 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-0c3004cf-178f-4e53-9796-dff342801eef tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:03.837566 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0c3004cf-178f-4e53-9796-dff342801eef tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:03.838269 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0c3004cf-178f-4e53-9796-dff342801eef tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:03.839095 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0c3004cf-178f-4e53-9796-dff342801eef tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:03.839586 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0c3004cf-178f-4e53-9796-dff342801eef tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:03.982974 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-0c3004cf-178f-4e53-9796-dff342801eef tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:03.995255 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-0c3004cf-178f-4e53-9796-dff342801eef tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:03.997280 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-0c3004cf-178f-4e53-9796-dff342801eef tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:03.998594 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-0c3004cf-178f-4e53-9796-dff342801eef tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.172915 Nov 21 13:55:03.999505 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 266/518] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:55:03 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:55:04.101664 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-2b03bfaf-89cb-4f5e-96e6-6e98568fcf3a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:04.102226 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-2b03bfaf-89cb-4f5e-96e6-6e98568fcf3a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:04.108222 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2b03bfaf-89cb-4f5e-96e6-6e98568fcf3a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:04.108682 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2b03bfaf-89cb-4f5e-96e6-6e98568fcf3a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:04.109603 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2b03bfaf-89cb-4f5e-96e6-6e98568fcf3a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:04.110219 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2b03bfaf-89cb-4f5e-96e6-6e98568fcf3a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:04.136502 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-2b03bfaf-89cb-4f5e-96e6-6e98568fcf3a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Going to try to terminate instance {{(pid=122565) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 21 13:55:04.247592 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-2b03bfaf-89cb-4f5e-96e6-6e98568fcf3a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "DELETE /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 204 len: 0 microversion: 2.1 time: 0.150013 Nov 21 13:55:04.248330 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 253/519] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 13:55:04 2021] DELETE /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 13:55:04.257033 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-d629de6f-e177-4228-bc06-a618862df06d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:04.257643 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-d629de6f-e177-4228-bc06-a618862df06d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:04.265059 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d629de6f-e177-4228-bc06-a618862df06d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:04.266681 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d629de6f-e177-4228-bc06-a618862df06d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:04.267562 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d629de6f-e177-4228-bc06-a618862df06d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:04.268238 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d629de6f-e177-4228-bc06-a618862df06d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:04.416987 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-d629de6f-e177-4228-bc06-a618862df06d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:04.425021 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-d629de6f-e177-4228-bc06-a618862df06d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1506 microversion: 2.1 time: 0.172111 Nov 21 13:55:04.426129 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 267/520] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:04 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:55:04.709185 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-43102509-f9bf-4c8d-ba16-79e41ad18aab req-ceaddbf8-5f5c-49c2-b44e-94b6ddb0afc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e92c59-3be1-41c7-8ea1-b1bb65cf39c1", "name": "network-vif-plugged", "status": "completed", "tag": "627d561d-d2ff-449e-a99f-9e5e3fd874ba"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:55:04.711821 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:55:04.711821 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:55:04.722028 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-43102509-f9bf-4c8d-ba16-79e41ad18aab req-ceaddbf8-5f5c-49c2-b44e-94b6ddb0afc2 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:04.722778 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-43102509-f9bf-4c8d-ba16-79e41ad18aab req-ceaddbf8-5f5c-49c2-b44e-94b6ddb0afc2 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:04.761513 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-43102509-f9bf-4c8d-ba16-79e41ad18aab req-ceaddbf8-5f5c-49c2-b44e-94b6ddb0afc2 service nova] Creating event network-vif-plugged:627d561d-d2ff-449e-a99f-9e5e3fd874ba for instance 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 on hv-cinder-76845 Nov 21 13:55:04.771081 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-43102509-f9bf-4c8d-ba16-79e41ad18aab req-ceaddbf8-5f5c-49c2-b44e-94b6ddb0afc2 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066735 Nov 21 13:55:04.771691 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 254/521] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:55:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:55:05.020433 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-238cfa20-f685-4d4a-a588-4950e1406595 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:05.021050 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-238cfa20-f685-4d4a-a588-4950e1406595 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:05.028134 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-238cfa20-f685-4d4a-a588-4950e1406595 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:05.028858 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-238cfa20-f685-4d4a-a588-4950e1406595 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:05.029819 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-238cfa20-f685-4d4a-a588-4950e1406595 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:05.030412 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-238cfa20-f685-4d4a-a588-4950e1406595 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:05.376428 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-238cfa20-f685-4d4a-a588-4950e1406595 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:05.386859 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-238cfa20-f685-4d4a-a588-4950e1406595 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:05.404642 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-238cfa20-f685-4d4a-a588-4950e1406595 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:05.412042 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-238cfa20-f685-4d4a-a588-4950e1406595 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.391504 Nov 21 13:55:05.423435 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 268/522] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:55:05 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:55:05.443956 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-4d2d31c7-ba18-4ddc-b5a9-a489c0160b88 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:05.444767 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-4d2d31c7-ba18-4ddc-b5a9-a489c0160b88 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:05.459088 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4d2d31c7-ba18-4ddc-b5a9-a489c0160b88 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:05.459998 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4d2d31c7-ba18-4ddc-b5a9-a489c0160b88 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:05.463636 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4d2d31c7-ba18-4ddc-b5a9-a489c0160b88 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:05.465320 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4d2d31c7-ba18-4ddc-b5a9-a489c0160b88 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:05.701263 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4d2d31c7-ba18-4ddc-b5a9-a489c0160b88 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:05.710633 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-4d2d31c7-ba18-4ddc-b5a9-a489c0160b88 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1506 microversion: 2.1 time: 0.271635 Nov 21 13:55:05.713893 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 255/523] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:05 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:06.431748 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-508c01f0-e94c-4bc3-af52-23e8a2bd4862 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:06.433083 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-508c01f0-e94c-4bc3-af52-23e8a2bd4862 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:06.442782 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-508c01f0-e94c-4bc3-af52-23e8a2bd4862 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:06.444599 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-508c01f0-e94c-4bc3-af52-23e8a2bd4862 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:06.447650 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-508c01f0-e94c-4bc3-af52-23e8a2bd4862 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:06.448917 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-508c01f0-e94c-4bc3-af52-23e8a2bd4862 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:06.740717 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-d500fad6-a6de-4f4b-a637-c150b568106d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:06.742047 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-d500fad6-a6de-4f4b-a637-c150b568106d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:06.758810 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d500fad6-a6de-4f4b-a637-c150b568106d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:06.759773 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d500fad6-a6de-4f4b-a637-c150b568106d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:06.760980 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d500fad6-a6de-4f4b-a637-c150b568106d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:06.761946 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d500fad6-a6de-4f4b-a637-c150b568106d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:06.870100 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-508c01f0-e94c-4bc3-af52-23e8a2bd4862 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:06.899312 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-508c01f0-e94c-4bc3-af52-23e8a2bd4862 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:06.906445 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-508c01f0-e94c-4bc3-af52-23e8a2bd4862 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:06.907697 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-508c01f0-e94c-4bc3-af52-23e8a2bd4862 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.481191 Nov 21 13:55:06.931644 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 269/524] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:55:06 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:55:07.131950 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-d500fad6-a6de-4f4b-a637-c150b568106d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:07.140154 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-d500fad6-a6de-4f4b-a637-c150b568106d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1506 microversion: 2.1 time: 0.413360 Nov 21 13:55:07.140753 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 256/525] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:06 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1506 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:55:07.575716 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-764dba9e-8f56-4ae2-b2c8-7871fc599963 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:07.576468 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-764dba9e-8f56-4ae2-b2c8-7871fc599963 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:07.587650 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-764dba9e-8f56-4ae2-b2c8-7871fc599963 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:07.596314 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-764dba9e-8f56-4ae2-b2c8-7871fc599963 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:07.602742 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-764dba9e-8f56-4ae2-b2c8-7871fc599963 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:07.603394 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-764dba9e-8f56-4ae2-b2c8-7871fc599963 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:07.917128 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.objects.instance [None req-764dba9e-8f56-4ae2-b2c8-7871fc599963 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lazy-loading 'services' on Instance uuid 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb {{(pid=122564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:55:07.928254 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-fcd4c885-9c44-49de-a1d6-39ade35cb65c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:07.928865 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-fcd4c885-9c44-49de-a1d6-39ade35cb65c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:07.936119 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fcd4c885-9c44-49de-a1d6-39ade35cb65c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:07.936572 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fcd4c885-9c44-49de-a1d6-39ade35cb65c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:07.937359 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fcd4c885-9c44-49de-a1d6-39ade35cb65c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:07.937817 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fcd4c885-9c44-49de-a1d6-39ade35cb65c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:08.154638 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-764dba9e-8f56-4ae2-b2c8-7871fc599963 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "DELETE /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/os-volume_attachments/2e8d26eb-9752-41df-b589-56703e6b2b9a" status: 202 len: 0 microversion: 2.1 time: 0.579952 Nov 21 13:55:08.156044 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 270/526] 10.222.0.11 () {58 vars in 1415 bytes} [Sun Nov 21 13:55:07 2021] DELETE /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/os-volume_attachments/2e8d26eb-9752-41df-b589-56703e6b2b9a => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:55:08.163480 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-6486144f-0b5f-431f-a188-72f55943c655 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:08.164657 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-6486144f-0b5f-431f-a188-72f55943c655 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:08.174444 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6486144f-0b5f-431f-a188-72f55943c655 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:08.175488 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6486144f-0b5f-431f-a188-72f55943c655 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:08.176923 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6486144f-0b5f-431f-a188-72f55943c655 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:08.177569 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6486144f-0b5f-431f-a188-72f55943c655 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:08.301398 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-6486144f-0b5f-431f-a188-72f55943c655 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:08.311766 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-6486144f-0b5f-431f-a188-72f55943c655 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 200 len: 1464 microversion: 2.1 time: 0.153983 Nov 21 13:55:08.312372 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 271/527] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:08 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:08.415446 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-2c450ace-8808-4210-86ed-2eb66c15ef2d req-5c869dbc-533b-47da-a254-296f5b6adf34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6f04799-b287-41b6-9756-b259d5eeddeb", "name": "network-vif-deleted", "tag": "dcf844c6-0002-4d63-9e63-4bf56191c807"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:55:08.418114 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:55:08.418114 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:55:08.427020 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-2c450ace-8808-4210-86ed-2eb66c15ef2d req-5c869dbc-533b-47da-a254-296f5b6adf34 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:08.427474 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-2c450ace-8808-4210-86ed-2eb66c15ef2d req-5c869dbc-533b-47da-a254-296f5b6adf34 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:08.441760 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-fcd4c885-9c44-49de-a1d6-39ade35cb65c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:08.443517 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-2c450ace-8808-4210-86ed-2eb66c15ef2d req-5c869dbc-533b-47da-a254-296f5b6adf34 service nova] Creating event network-vif-deleted:dcf844c6-0002-4d63-9e63-4bf56191c807 for instance e6f04799-b287-41b6-9756-b259d5eeddeb on hv-cinder-76845 Nov 21 13:55:08.468416 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-fcd4c885-9c44-49de-a1d6-39ade35cb65c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:08.473131 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-2c450ace-8808-4210-86ed-2eb66c15ef2d req-5c869dbc-533b-47da-a254-296f5b6adf34 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053009 Nov 21 13:55:08.474642 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-fcd4c885-9c44-49de-a1d6-39ade35cb65c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:08.475602 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 272/528] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:55:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:55:08.477785 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-fcd4c885-9c44-49de-a1d6-39ade35cb65c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1810 microversion: 2.20 time: 0.555139 Nov 21 13:55:08.479305 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 257/529] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:55:07 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1810 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:55:09.329515 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-bd8abc4f-bea2-4d95-90a9-17d60e2f0e7a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:09.330774 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-bd8abc4f-bea2-4d95-90a9-17d60e2f0e7a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: e6f04799-b287-41b6-9756-b259d5eeddeb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:09.338607 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bd8abc4f-bea2-4d95-90a9-17d60e2f0e7a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:09.339291 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bd8abc4f-bea2-4d95-90a9-17d60e2f0e7a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:09.340304 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bd8abc4f-bea2-4d95-90a9-17d60e2f0e7a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:09.340770 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bd8abc4f-bea2-4d95-90a9-17d60e2f0e7a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:09.355229 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.wsgi [None req-bd8abc4f-bea2-4d95-90a9-17d60e2f0e7a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] HTTP exception thrown: Instance e6f04799-b287-41b6-9756-b259d5eeddeb could not be found. Nov 21 13:55:09.355832 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-bd8abc4f-bea2-4d95-90a9-17d60e2f0e7a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Returning 404 to user: Instance e6f04799-b287-41b6-9756-b259d5eeddeb could not be found. {{(pid=122564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:55:09.356667 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-bd8abc4f-bea2-4d95-90a9-17d60e2f0e7a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb" status: 404 len: 111 microversion: 2.1 time: 0.031615 Nov 21 13:55:09.357203 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 273/530] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:09 2021] GET /compute/v2.1/servers/e6f04799-b287-41b6-9756-b259d5eeddeb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:55:09.369097 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-04e289a7-a230-423a-b7e2-4e9f663ada4b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:09.369705 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-04e289a7-a230-423a-b7e2-4e9f663ada4b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:09.386821 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-04e289a7-a230-423a-b7e2-4e9f663ada4b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:09.387462 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-04e289a7-a230-423a-b7e2-4e9f663ada4b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:09.388733 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-04e289a7-a230-423a-b7e2-4e9f663ada4b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:09.390311 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-04e289a7-a230-423a-b7e2-4e9f663ada4b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:09.418617 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-3a38c9be-e1d5-4eb7-b46f-3377da560f9c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:55:09.427060 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3a38c9be-e1d5-4eb7-b46f-3377da560f9c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:09.427517 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3a38c9be-e1d5-4eb7-b46f-3377da560f9c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:09.430211 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-04e289a7-a230-423a-b7e2-4e9f663ada4b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Going to try to terminate instance {{(pid=122565) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 21 13:55:09.513933 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3a38c9be-e1d5-4eb7-b46f-3377da560f9c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Going to try to stop instance {{(pid=122564) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 21 13:55:09.554427 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-04e289a7-a230-423a-b7e2-4e9f663ada4b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "DELETE /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 204 len: 0 microversion: 2.1 time: 0.192579 Nov 21 13:55:09.555778 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 258/531] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 13:55:09 2021] DELETE /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 13:55:09.564800 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-bcf10e63-a47a-4701-be8a-b1127f2a584c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:09.565639 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-bcf10e63-a47a-4701-be8a-b1127f2a584c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:09.572406 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bcf10e63-a47a-4701-be8a-b1127f2a584c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:09.573208 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bcf10e63-a47a-4701-be8a-b1127f2a584c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:09.573346 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-3a38c9be-e1d5-4eb7-b46f-3377da560f9c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 202 len: 0 microversion: 2.1 time: 0.158747 Nov 21 13:55:09.574176 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 274/532] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:55:09 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:55:09.574633 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bcf10e63-a47a-4701-be8a-b1127f2a584c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:09.575289 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bcf10e63-a47a-4701-be8a-b1127f2a584c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:09.579352 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-7b13c934-4b10-456c-8dbb-c4baacc20461 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:09.580328 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-7b13c934-4b10-456c-8dbb-c4baacc20461 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:09.587289 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7b13c934-4b10-456c-8dbb-c4baacc20461 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:09.588000 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7b13c934-4b10-456c-8dbb-c4baacc20461 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:09.588958 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7b13c934-4b10-456c-8dbb-c4baacc20461 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:09.589558 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7b13c934-4b10-456c-8dbb-c4baacc20461 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:09.790241 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-7b13c934-4b10-456c-8dbb-c4baacc20461 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:09.795296 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bcf10e63-a47a-4701-be8a-b1127f2a584c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:09.800348 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-7b13c934-4b10-456c-8dbb-c4baacc20461 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.224862 Nov 21 13:55:09.805098 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bcf10e63-a47a-4701-be8a-b1127f2a584c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:09.806722 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bcf10e63-a47a-4701-be8a-b1127f2a584c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:09.808039 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-bcf10e63-a47a-4701-be8a-b1127f2a584c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1797 microversion: 2.20 time: 0.250796 Nov 21 13:55:09.808703 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 259/533] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:55:09 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1797 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:55:09.815982 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 275/534] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:09 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:09.816375 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-611313aa-071a-4078-8a85-1cb2c90b33f7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:09.817098 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-611313aa-071a-4078-8a85-1cb2c90b33f7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:09.836625 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-611313aa-071a-4078-8a85-1cb2c90b33f7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:09.837077 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-611313aa-071a-4078-8a85-1cb2c90b33f7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:09.837872 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-611313aa-071a-4078-8a85-1cb2c90b33f7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:09.838314 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-611313aa-071a-4078-8a85-1cb2c90b33f7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:09.982500 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-611313aa-071a-4078-8a85-1cb2c90b33f7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:09.992471 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-611313aa-071a-4078-8a85-1cb2c90b33f7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1677 microversion: 2.1 time: 0.182403 Nov 21 13:55:10.016027 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 260/535] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:09 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1677 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:10.817895 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-784af963-5866-4f89-9758-3d0ebdb68138 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:10.818513 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-784af963-5866-4f89-9758-3d0ebdb68138 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:10.825240 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-784af963-5866-4f89-9758-3d0ebdb68138 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:10.825696 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-784af963-5866-4f89-9758-3d0ebdb68138 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:10.826477 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-784af963-5866-4f89-9758-3d0ebdb68138 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:10.827081 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-784af963-5866-4f89-9758-3d0ebdb68138 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:11.010115 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ad48c1ed-1e76-4d1d-8ef1-838e07722d99 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:11.010733 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ad48c1ed-1e76-4d1d-8ef1-838e07722d99 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:11.022566 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ad48c1ed-1e76-4d1d-8ef1-838e07722d99 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:11.023025 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ad48c1ed-1e76-4d1d-8ef1-838e07722d99 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:11.023878 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ad48c1ed-1e76-4d1d-8ef1-838e07722d99 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:11.024570 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-784af963-5866-4f89-9758-3d0ebdb68138 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:11.024707 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ad48c1ed-1e76-4d1d-8ef1-838e07722d99 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:11.034231 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-784af963-5866-4f89-9758-3d0ebdb68138 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.219866 Nov 21 13:55:11.034803 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 276/536] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:10 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:11.218959 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ad48c1ed-1e76-4d1d-8ef1-838e07722d99 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:11.228054 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ad48c1ed-1e76-4d1d-8ef1-838e07722d99 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1677 microversion: 2.1 time: 0.221391 Nov 21 13:55:11.228628 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 261/537] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:11 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1677 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:55:12.053419 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-bf2e70dc-5811-499e-8681-1ad12abbe68c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:12.054479 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-bf2e70dc-5811-499e-8681-1ad12abbe68c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:12.061550 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bf2e70dc-5811-499e-8681-1ad12abbe68c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:12.062002 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bf2e70dc-5811-499e-8681-1ad12abbe68c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:12.062953 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bf2e70dc-5811-499e-8681-1ad12abbe68c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:12.063237 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bf2e70dc-5811-499e-8681-1ad12abbe68c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:12.217437 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-bf2e70dc-5811-499e-8681-1ad12abbe68c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:12.226157 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-bf2e70dc-5811-499e-8681-1ad12abbe68c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.176726 Nov 21 13:55:12.226911 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 277/538] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:12 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:12.244564 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-e0fdc896-a401-447d-bc4f-a3b88037b5f2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:12.245180 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-e0fdc896-a401-447d-bc4f-a3b88037b5f2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:12.254205 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e0fdc896-a401-447d-bc4f-a3b88037b5f2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:12.257270 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e0fdc896-a401-447d-bc4f-a3b88037b5f2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:12.258265 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e0fdc896-a401-447d-bc4f-a3b88037b5f2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:12.268184 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e0fdc896-a401-447d-bc4f-a3b88037b5f2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:12.447762 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-e0fdc896-a401-447d-bc4f-a3b88037b5f2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:12.455798 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-e0fdc896-a401-447d-bc4f-a3b88037b5f2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1677 microversion: 2.1 time: 0.214544 Nov 21 13:55:12.459877 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 262/539] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:12 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:13.242939 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-632ee505-a9a6-4b2e-a57d-642cb6a477fe tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:13.243542 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-632ee505-a9a6-4b2e-a57d-642cb6a477fe tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:13.250218 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-632ee505-a9a6-4b2e-a57d-642cb6a477fe tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:13.251157 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-632ee505-a9a6-4b2e-a57d-642cb6a477fe tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:13.252219 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-632ee505-a9a6-4b2e-a57d-642cb6a477fe tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:13.252859 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-632ee505-a9a6-4b2e-a57d-642cb6a477fe tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:13.412109 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-632ee505-a9a6-4b2e-a57d-642cb6a477fe tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:13.421588 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-632ee505-a9a6-4b2e-a57d-642cb6a477fe tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.182128 Nov 21 13:55:13.422740 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 278/540] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:13 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:13.472881 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-4b148de3-8f6c-443d-9da2-77e5d28ce619 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:13.474451 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-4b148de3-8f6c-443d-9da2-77e5d28ce619 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:13.481209 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4b148de3-8f6c-443d-9da2-77e5d28ce619 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:13.481875 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4b148de3-8f6c-443d-9da2-77e5d28ce619 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:13.482803 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4b148de3-8f6c-443d-9da2-77e5d28ce619 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:13.483534 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4b148de3-8f6c-443d-9da2-77e5d28ce619 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:13.626639 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4b148de3-8f6c-443d-9da2-77e5d28ce619 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:13.635719 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-4b148de3-8f6c-443d-9da2-77e5d28ce619 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1677 microversion: 2.1 time: 0.166433 Nov 21 13:55:13.636624 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 263/541] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:13 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:14.438639 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-efabaaca-ab54-4a9b-bf1e-9f65902e3cb9 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:14.439183 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-efabaaca-ab54-4a9b-bf1e-9f65902e3cb9 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:14.447088 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-efabaaca-ab54-4a9b-bf1e-9f65902e3cb9 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:14.447558 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-efabaaca-ab54-4a9b-bf1e-9f65902e3cb9 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:14.448420 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-efabaaca-ab54-4a9b-bf1e-9f65902e3cb9 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:14.448860 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-efabaaca-ab54-4a9b-bf1e-9f65902e3cb9 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:14.621419 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-efabaaca-ab54-4a9b-bf1e-9f65902e3cb9 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:14.629726 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-efabaaca-ab54-4a9b-bf1e-9f65902e3cb9 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.194958 Nov 21 13:55:14.630293 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 279/542] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:14 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:14.651643 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-89e41f6f-8323-4835-bd14-2d3b393eb975 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:14.652402 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-89e41f6f-8323-4835-bd14-2d3b393eb975 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:14.658935 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-89e41f6f-8323-4835-bd14-2d3b393eb975 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:14.659635 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-89e41f6f-8323-4835-bd14-2d3b393eb975 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:14.660202 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-89e41f6f-8323-4835-bd14-2d3b393eb975 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:14.660644 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-89e41f6f-8323-4835-bd14-2d3b393eb975 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:14.803106 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-89e41f6f-8323-4835-bd14-2d3b393eb975 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:14.811379 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-89e41f6f-8323-4835-bd14-2d3b393eb975 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1677 microversion: 2.1 time: 0.163412 Nov 21 13:55:14.812563 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 264/543] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:14 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:15.646689 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2de15cfa-c93e-4301-9bcf-ff11cd2e4a6d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:15.647305 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-2de15cfa-c93e-4301-9bcf-ff11cd2e4a6d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:15.653998 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2de15cfa-c93e-4301-9bcf-ff11cd2e4a6d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:15.654458 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2de15cfa-c93e-4301-9bcf-ff11cd2e4a6d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:15.655263 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2de15cfa-c93e-4301-9bcf-ff11cd2e4a6d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:15.655708 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2de15cfa-c93e-4301-9bcf-ff11cd2e4a6d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:15.830040 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-0c586bcd-7c14-4c84-aa0a-98ebfcdd762f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:15.831198 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-0c586bcd-7c14-4c84-aa0a-98ebfcdd762f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:15.832857 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-2de15cfa-c93e-4301-9bcf-ff11cd2e4a6d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd748cde4c5e443bb6d87d862cf31357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:15.844812 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-2de15cfa-c93e-4301-9bcf-ff11cd2e4a6d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 200 len: 1521 microversion: 2.1 time: 0.202080 Nov 21 13:55:15.845582 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 280/544] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:15 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:15.849792 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0c586bcd-7c14-4c84-aa0a-98ebfcdd762f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:15.850253 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0c586bcd-7c14-4c84-aa0a-98ebfcdd762f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:15.851065 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0c586bcd-7c14-4c84-aa0a-98ebfcdd762f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:15.851500 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0c586bcd-7c14-4c84-aa0a-98ebfcdd762f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:16.046570 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-0c586bcd-7c14-4c84-aa0a-98ebfcdd762f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:16.054484 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-0c586bcd-7c14-4c84-aa0a-98ebfcdd762f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1677 microversion: 2.1 time: 0.228922 Nov 21 13:55:16.057004 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 265/545] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:15 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1677 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:16.238553 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-f3ebd8ba-e8d8-43ec-92c0-4182623d989a req-a90622ff-57da-47c6-bb84-f6b5cf85f1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d1c9d3d-f088-4d2f-b2bc-e26543509aae", "name": "network-vif-deleted", "tag": "e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:55:16.240180 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:55:16.240180 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:55:16.248801 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-f3ebd8ba-e8d8-43ec-92c0-4182623d989a req-a90622ff-57da-47c6-bb84-f6b5cf85f1d1 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:16.249253 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-f3ebd8ba-e8d8-43ec-92c0-4182623d989a req-a90622ff-57da-47c6-bb84-f6b5cf85f1d1 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:16.262925 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-f3ebd8ba-e8d8-43ec-92c0-4182623d989a req-a90622ff-57da-47c6-bb84-f6b5cf85f1d1 service nova] Creating event network-vif-deleted:e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 for instance 2d1c9d3d-f088-4d2f-b2bc-e26543509aae on hv-cinder-76845 Nov 21 13:55:16.268475 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-f3ebd8ba-e8d8-43ec-92c0-4182623d989a req-a90622ff-57da-47c6-bb84-f6b5cf85f1d1 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040214 Nov 21 13:55:16.269787 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 281/546] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:55:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:55:16.861578 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-64d34aa8-e5f0-4497-a13d-b4acd5408750 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:16.862356 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-64d34aa8-e5f0-4497-a13d-b4acd5408750 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] [instance: 2d1c9d3d-f088-4d2f-b2bc-e26543509aae] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:16.869681 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-64d34aa8-e5f0-4497-a13d-b4acd5408750 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:16.870135 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-64d34aa8-e5f0-4497-a13d-b4acd5408750 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:16.873240 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-64d34aa8-e5f0-4497-a13d-b4acd5408750 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:16.873967 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-64d34aa8-e5f0-4497-a13d-b4acd5408750 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:16.888118 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-64d34aa8-e5f0-4497-a13d-b4acd5408750 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] HTTP exception thrown: Instance 2d1c9d3d-f088-4d2f-b2bc-e26543509aae could not be found. Nov 21 13:55:16.889066 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-64d34aa8-e5f0-4497-a13d-b4acd5408750 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Returning 404 to user: Instance 2d1c9d3d-f088-4d2f-b2bc-e26543509aae could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:55:16.889907 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-64d34aa8-e5f0-4497-a13d-b4acd5408750 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae" status: 404 len: 111 microversion: 2.1 time: 0.032209 Nov 21 13:55:16.894764 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 266/547] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:16 2021] GET /compute/v2.1/servers/2d1c9d3d-f088-4d2f-b2bc-e26543509aae => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:55:17.074617 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-860319c1-243b-42e0-8bce-c17ca744ea31 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:17.076449 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-860319c1-243b-42e0-8bce-c17ca744ea31 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:17.084485 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-860319c1-243b-42e0-8bce-c17ca744ea31 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:17.085232 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-860319c1-243b-42e0-8bce-c17ca744ea31 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:17.086464 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-860319c1-243b-42e0-8bce-c17ca744ea31 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:17.087292 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-860319c1-243b-42e0-8bce-c17ca744ea31 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:17.162922 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 13:55:17.163146 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: Sun Nov 21 13:55:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb (ip 10.222.0.11) !!! Nov 21 13:55:17.340739 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-860319c1-243b-42e0-8bce-c17ca744ea31 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:17.350023 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-860319c1-243b-42e0-8bce-c17ca744ea31 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1677 microversion: 2.1 time: 0.279715 Nov 21 13:55:17.352110 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 282/548] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:17 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1677 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:17.946921 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ebe83dab-0eea-4fba-a75a-9e730b4f6d90 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Action: 'create', calling method: .version_select at 0x7fd513531820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-146073214"}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:55:17.961228 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-ebe83dab-0eea-4fba-a75a-9e730b4f6d90 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Getting quotas for project 406bef8592334a749f671da6881b0cf5. Resources: {'key_pairs'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:55:17.965123 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-ebe83dab-0eea-4fba-a75a-9e730b4f6d90 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Getting quotas for user 26909ec566cc4b59b271cb089f0078a0 and project 406bef8592334a749f671da6881b0cf5. Resources: {'key_pairs'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:55:18.147357 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-ebe83dab-0eea-4fba-a75a-9e730b4f6d90 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Getting quotas for project 406bef8592334a749f671da6881b0cf5. Resources: {'key_pairs'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:55:18.152916 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-ebe83dab-0eea-4fba-a75a-9e730b4f6d90 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Getting quotas for user 26909ec566cc4b59b271cb089f0078a0 and project 406bef8592334a749f671da6881b0cf5. Resources: {'key_pairs'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:55:18.175902 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ebe83dab-0eea-4fba-a75a-9e730b4f6d90 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.232271 Nov 21 13:55:18.187335 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 267/549] 10.222.0.11 () {60 vars in 1157 bytes} [Sun Nov 21 13:55:17 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:18.226496 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1320148787", "imageRef": "55c79dbc-e32d-4dc6-b3c2-c70707e8fcd4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-146073214", "networks": [{"uuid": "34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9"}]}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:55:18.280474 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.network.neutron [None req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] validate_networks() for [('34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9', None, None, None, None, None)] {{(pid=122564) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 21 13:55:18.369470 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-7c1cf9d1-ad13-4152-b232-be756132dcf7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:18.370085 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-7c1cf9d1-ad13-4152-b232-be756132dcf7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:18.379029 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7c1cf9d1-ad13-4152-b232-be756132dcf7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:18.379486 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7c1cf9d1-ad13-4152-b232-be756132dcf7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:18.380302 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7c1cf9d1-ad13-4152-b232-be756132dcf7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:18.380734 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7c1cf9d1-ad13-4152-b232-be756132dcf7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:18.509092 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-7c1cf9d1-ad13-4152-b232-be756132dcf7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:18.516542 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-7c1cf9d1-ad13-4152-b232-be756132dcf7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1677 microversion: 2.1 time: 0.150825 Nov 21 13:55:18.517437 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 268/550] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:18 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:55:18.950424 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Flavor limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 13:55:18.950947 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Image limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 13:55:18.951430 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Flavor pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 13:55:18.951891 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Image pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 13:55:18.952305 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 13:55:18.960853 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:18.961306 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:18.962170 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:18.962646 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:18.986566 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Getting quotas for project 406bef8592334a749f671da6881b0cf5. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:55:18.992235 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Getting quotas for user 26909ec566cc4b59b271cb089f0078a0 and project 406bef8592334a749f671da6881b0cf5. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:55:19.005983 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Going to run 1 instances... {{(pid=122564) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 13:55:19.008919 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='55c79dbc-e32d-4dc6-b3c2-c70707e8fcd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 13:55:19.074916 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.852374 Nov 21 13:55:19.080560 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 283/551] 10.222.0.11 () {60 vars in 1146 bytes} [Sun Nov 21 13:55:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 13:55:19.085295 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-4203f309-7b06-4a65-b569-46039b1a34fa tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:19.086515 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-4203f309-7b06-4a65-b569-46039b1a34fa tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:19.158263 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4203f309-7b06-4a65-b569-46039b1a34fa tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:19.170623 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-4203f309-7b06-4a65-b569-46039b1a34fa tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1258 microversion: 2.1 time: 0.089064 Nov 21 13:55:19.171729 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 269/552] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:19 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1258 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:19.534634 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b55a39a4-982e-436e-a5b4-8145413c0fbc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:19.536067 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b55a39a4-982e-436e-a5b4-8145413c0fbc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:19.542976 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b55a39a4-982e-436e-a5b4-8145413c0fbc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:19.543671 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b55a39a4-982e-436e-a5b4-8145413c0fbc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:19.544704 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b55a39a4-982e-436e-a5b4-8145413c0fbc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:19.545302 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b55a39a4-982e-436e-a5b4-8145413c0fbc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:19.693710 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-b55a39a4-982e-436e-a5b4-8145413c0fbc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:19.702045 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-b55a39a4-982e-436e-a5b4-8145413c0fbc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1677 microversion: 2.1 time: 0.171542 Nov 21 13:55:19.702633 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 284/553] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:19 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:20.190374 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-24090163-5a67-4b8a-a86a-8935e7ace22e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:20.190963 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-24090163-5a67-4b8a-a86a-8935e7ace22e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:20.198930 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-24090163-5a67-4b8a-a86a-8935e7ace22e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:20.199371 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-24090163-5a67-4b8a-a86a-8935e7ace22e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:20.200192 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-24090163-5a67-4b8a-a86a-8935e7ace22e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:20.200630 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-24090163-5a67-4b8a-a86a-8935e7ace22e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:20.290289 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-24090163-5a67-4b8a-a86a-8935e7ace22e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:20.298923 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-24090163-5a67-4b8a-a86a-8935e7ace22e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1318 microversion: 2.1 time: 0.112231 Nov 21 13:55:20.300232 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 270/554] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:20 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1318 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:20.731848 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-1709d0ea-4a37-4ebd-b6b6-fcdf8dc68616 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:20.734086 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-1709d0ea-4a37-4ebd-b6b6-fcdf8dc68616 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:20.746060 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1709d0ea-4a37-4ebd-b6b6-fcdf8dc68616 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:20.750139 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1709d0ea-4a37-4ebd-b6b6-fcdf8dc68616 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:20.751242 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1709d0ea-4a37-4ebd-b6b6-fcdf8dc68616 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:20.751689 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1709d0ea-4a37-4ebd-b6b6-fcdf8dc68616 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:21.323143 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-170edc4f-aca9-4a1b-8180-51db5eb8a740 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:21.327009 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-170edc4f-aca9-4a1b-8180-51db5eb8a740 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:21.343755 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-170edc4f-aca9-4a1b-8180-51db5eb8a740 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:21.344266 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-170edc4f-aca9-4a1b-8180-51db5eb8a740 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:21.345090 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-170edc4f-aca9-4a1b-8180-51db5eb8a740 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:21.345535 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-170edc4f-aca9-4a1b-8180-51db5eb8a740 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:21.408989 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-1709d0ea-4a37-4ebd-b6b6-fcdf8dc68616 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:21.416923 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-1709d0ea-4a37-4ebd-b6b6-fcdf8dc68616 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1654 microversion: 2.1 time: 0.700711 Nov 21 13:55:21.417503 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 285/555] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:20 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1654 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:21.448961 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-937fccde-cacf-4fbe-9e40-b6ed954a71a1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:55:21.464259 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-937fccde-cacf-4fbe-9e40-b6ed954a71a1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:21.466162 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-937fccde-cacf-4fbe-9e40-b6ed954a71a1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:21.561565 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-937fccde-cacf-4fbe-9e40-b6ed954a71a1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Going to try to start instance {{(pid=122564) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 21 13:55:21.677664 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-937fccde-cacf-4fbe-9e40-b6ed954a71a1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action" status: 202 len: 0 microversion: 2.1 time: 0.245551 Nov 21 13:55:21.684063 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 286/556] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:55:21 2021] POST /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:55:21.694626 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-6552099d-fcee-4f52-961d-db2b09298677 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:21.696549 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-6552099d-fcee-4f52-961d-db2b09298677 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:21.715344 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-170edc4f-aca9-4a1b-8180-51db5eb8a740 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:21.726604 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6552099d-fcee-4f52-961d-db2b09298677 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:21.728778 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6552099d-fcee-4f52-961d-db2b09298677 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:21.729914 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6552099d-fcee-4f52-961d-db2b09298677 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:21.732545 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6552099d-fcee-4f52-961d-db2b09298677 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:21.739975 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-170edc4f-aca9-4a1b-8180-51db5eb8a740 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1358 microversion: 2.1 time: 0.426029 Nov 21 13:55:21.741065 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 271/557] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:21 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1358 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:22.035270 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-6552099d-fcee-4f52-961d-db2b09298677 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:22.043456 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-6552099d-fcee-4f52-961d-db2b09298677 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1663 microversion: 2.1 time: 0.355969 Nov 21 13:55:22.044062 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 287/558] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:21 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1663 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:22.343517 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-df22fb5b-0b19-4a8c-a5bf-0c3eb81d898f req-f73524ff-0292-4cb1-839e-c5f1129986c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b1367a1-8117-4d60-9d06-1a59f6ac647d", "tag": "0f9a92e8-efd7-45cc-b13f-25658f0506ad"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:55:22.345132 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:55:22.345132 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:55:22.355320 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-df22fb5b-0b19-4a8c-a5bf-0c3eb81d898f req-f73524ff-0292-4cb1-839e-c5f1129986c4 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:22.355832 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-df22fb5b-0b19-4a8c-a5bf-0c3eb81d898f req-f73524ff-0292-4cb1-839e-c5f1129986c4 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:22.378960 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-df22fb5b-0b19-4a8c-a5bf-0c3eb81d898f req-f73524ff-0292-4cb1-839e-c5f1129986c4 service nova] Creating event network-changed:0f9a92e8-efd7-45cc-b13f-25658f0506ad for instance 9b1367a1-8117-4d60-9d06-1a59f6ac647d on hv-cinder-76845 Nov 21 13:55:22.389009 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-df22fb5b-0b19-4a8c-a5bf-0c3eb81d898f req-f73524ff-0292-4cb1-839e-c5f1129986c4 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049917 Nov 21 13:55:22.392973 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 272/559] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:55:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:55:22.757903 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-33506675-463c-4933-bbb2-7c4cc6568e85 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:22.759199 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-33506675-463c-4933-bbb2-7c4cc6568e85 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:22.765612 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-33506675-463c-4933-bbb2-7c4cc6568e85 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:22.766066 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-33506675-463c-4933-bbb2-7c4cc6568e85 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:22.766850 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-33506675-463c-4933-bbb2-7c4cc6568e85 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:22.767294 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-33506675-463c-4933-bbb2-7c4cc6568e85 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:22.944895 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-33506675-463c-4933-bbb2-7c4cc6568e85 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:22.952911 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-33506675-463c-4933-bbb2-7c4cc6568e85 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1358 microversion: 2.1 time: 0.198533 Nov 21 13:55:22.953576 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 288/560] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:22 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:23.061539 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-7ba8315d-35be-41b0-90c8-091f4b51ad5d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:23.062243 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-7ba8315d-35be-41b0-90c8-091f4b51ad5d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:23.068753 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7ba8315d-35be-41b0-90c8-091f4b51ad5d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:23.069214 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7ba8315d-35be-41b0-90c8-091f4b51ad5d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:23.070016 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7ba8315d-35be-41b0-90c8-091f4b51ad5d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:23.070462 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7ba8315d-35be-41b0-90c8-091f4b51ad5d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:23.221830 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-7ba8315d-35be-41b0-90c8-091f4b51ad5d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:23.229596 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-7ba8315d-35be-41b0-90c8-091f4b51ad5d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1663 microversion: 2.1 time: 0.172199 Nov 21 13:55:23.240474 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 273/561] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:23 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1663 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:23.970155 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-132c62e0-3999-4c55-a1d5-6a938587af7e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:23.984830 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-132c62e0-3999-4c55-a1d5-6a938587af7e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:23.995348 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-132c62e0-3999-4c55-a1d5-6a938587af7e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:23.995967 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-132c62e0-3999-4c55-a1d5-6a938587af7e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:23.996840 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-132c62e0-3999-4c55-a1d5-6a938587af7e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:23.997623 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-132c62e0-3999-4c55-a1d5-6a938587af7e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:24.183683 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-132c62e0-3999-4c55-a1d5-6a938587af7e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:24.195764 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-132c62e0-3999-4c55-a1d5-6a938587af7e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1358 microversion: 2.1 time: 0.229126 Nov 21 13:55:24.207454 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 289/562] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:23 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:24.248327 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-88f85bf7-130d-4c2b-a0e6-9f0a8d62f23d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:24.249031 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-88f85bf7-130d-4c2b-a0e6-9f0a8d62f23d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:24.256254 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-88f85bf7-130d-4c2b-a0e6-9f0a8d62f23d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:24.256812 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-88f85bf7-130d-4c2b-a0e6-9f0a8d62f23d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:24.257718 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-88f85bf7-130d-4c2b-a0e6-9f0a8d62f23d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:24.258227 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-88f85bf7-130d-4c2b-a0e6-9f0a8d62f23d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:24.444332 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-88f85bf7-130d-4c2b-a0e6-9f0a8d62f23d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:24.452334 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-88f85bf7-130d-4c2b-a0e6-9f0a8d62f23d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1663 microversion: 2.1 time: 0.208417 Nov 21 13:55:24.452906 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 274/563] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:24 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1663 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:25.214262 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-65df8cfe-71ee-4ec0-8555-3f3679a10ffc tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:25.215571 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-65df8cfe-71ee-4ec0-8555-3f3679a10ffc tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:25.224064 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-65df8cfe-71ee-4ec0-8555-3f3679a10ffc tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:25.225086 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-65df8cfe-71ee-4ec0-8555-3f3679a10ffc tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:25.226091 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-65df8cfe-71ee-4ec0-8555-3f3679a10ffc tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:25.226864 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-65df8cfe-71ee-4ec0-8555-3f3679a10ffc tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:25.425629 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-65df8cfe-71ee-4ec0-8555-3f3679a10ffc tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:25.433926 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-65df8cfe-71ee-4ec0-8555-3f3679a10ffc tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1358 microversion: 2.1 time: 0.224624 Nov 21 13:55:25.434496 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 290/564] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:25 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:55:25.470361 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-f7ed3769-1b70-4eb3-afe9-ca1a55b8b3f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:25.471403 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-f7ed3769-1b70-4eb3-afe9-ca1a55b8b3f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:25.480290 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f7ed3769-1b70-4eb3-afe9-ca1a55b8b3f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:25.480825 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f7ed3769-1b70-4eb3-afe9-ca1a55b8b3f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:25.481744 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f7ed3769-1b70-4eb3-afe9-ca1a55b8b3f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:25.482193 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f7ed3769-1b70-4eb3-afe9-ca1a55b8b3f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:25.646415 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-f7ed3769-1b70-4eb3-afe9-ca1a55b8b3f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:25.653761 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-f7ed3769-1b70-4eb3-afe9-ca1a55b8b3f4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1663 microversion: 2.1 time: 0.188267 Nov 21 13:55:25.654320 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 275/565] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:25 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1663 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:26.450646 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2ab34e42-8110-4096-a984-7ca7b96b1638 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:26.452195 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-2ab34e42-8110-4096-a984-7ca7b96b1638 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:26.458660 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2ab34e42-8110-4096-a984-7ca7b96b1638 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:26.459309 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2ab34e42-8110-4096-a984-7ca7b96b1638 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:26.460256 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2ab34e42-8110-4096-a984-7ca7b96b1638 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:26.460765 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2ab34e42-8110-4096-a984-7ca7b96b1638 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:26.619113 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-2ab34e42-8110-4096-a984-7ca7b96b1638 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:26.626722 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-2ab34e42-8110-4096-a984-7ca7b96b1638 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1358 microversion: 2.1 time: 0.179928 Nov 21 13:55:26.627287 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 291/566] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:26 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:26.671727 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-9b895ed1-7872-4d1b-8251-6568370ba27f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:26.673215 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-9b895ed1-7872-4d1b-8251-6568370ba27f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:26.680540 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9b895ed1-7872-4d1b-8251-6568370ba27f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:26.681265 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9b895ed1-7872-4d1b-8251-6568370ba27f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:26.682227 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9b895ed1-7872-4d1b-8251-6568370ba27f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:26.683099 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9b895ed1-7872-4d1b-8251-6568370ba27f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:26.828755 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-9b895ed1-7872-4d1b-8251-6568370ba27f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:26.838431 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-9b895ed1-7872-4d1b-8251-6568370ba27f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1663 microversion: 2.1 time: 0.170571 Nov 21 13:55:26.839386 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 276/567] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:26 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1663 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:27.644086 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-c9cc5899-91c0-45a1-b248-52e9a12fce52 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:27.645365 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-c9cc5899-91c0-45a1-b248-52e9a12fce52 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:27.651965 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c9cc5899-91c0-45a1-b248-52e9a12fce52 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:27.652541 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c9cc5899-91c0-45a1-b248-52e9a12fce52 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:27.653360 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c9cc5899-91c0-45a1-b248-52e9a12fce52 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:27.653963 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c9cc5899-91c0-45a1-b248-52e9a12fce52 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:27.792438 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-c9cc5899-91c0-45a1-b248-52e9a12fce52 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:27.799912 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-c9cc5899-91c0-45a1-b248-52e9a12fce52 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1358 microversion: 2.1 time: 0.159942 Nov 21 13:55:27.800982 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 292/568] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:27 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:27.856944 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-20feee71-a282-4ff8-a5a5-d1d59dd1ee81 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:27.857553 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-20feee71-a282-4ff8-a5a5-d1d59dd1ee81 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:27.863757 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-20feee71-a282-4ff8-a5a5-d1d59dd1ee81 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:27.864244 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-20feee71-a282-4ff8-a5a5-d1d59dd1ee81 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:27.865022 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-20feee71-a282-4ff8-a5a5-d1d59dd1ee81 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:27.865454 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-20feee71-a282-4ff8-a5a5-d1d59dd1ee81 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:28.002915 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-20feee71-a282-4ff8-a5a5-d1d59dd1ee81 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:28.010631 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-20feee71-a282-4ff8-a5a5-d1d59dd1ee81 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1663 microversion: 2.1 time: 0.157720 Nov 21 13:55:28.011186 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 277/569] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:27 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:28.818384 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2ee9e8ff-ea3b-484c-a23a-0de854c3a1ea tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:28.819833 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-2ee9e8ff-ea3b-484c-a23a-0de854c3a1ea tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:28.826878 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2ee9e8ff-ea3b-484c-a23a-0de854c3a1ea tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:28.827633 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2ee9e8ff-ea3b-484c-a23a-0de854c3a1ea tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:28.828742 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2ee9e8ff-ea3b-484c-a23a-0de854c3a1ea tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:28.829370 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2ee9e8ff-ea3b-484c-a23a-0de854c3a1ea tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:28.972642 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-2ee9e8ff-ea3b-484c-a23a-0de854c3a1ea tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:28.980041 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-2ee9e8ff-ea3b-484c-a23a-0de854c3a1ea tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1358 microversion: 2.1 time: 0.165844 Nov 21 13:55:28.980621 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 293/570] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:28 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:29.028246 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-83c8bf00-04c0-4b50-81e4-84ce32288bb4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:29.029595 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-83c8bf00-04c0-4b50-81e4-84ce32288bb4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:29.036420 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-83c8bf00-04c0-4b50-81e4-84ce32288bb4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:29.036871 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-83c8bf00-04c0-4b50-81e4-84ce32288bb4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:29.037664 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-83c8bf00-04c0-4b50-81e4-84ce32288bb4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:29.038106 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-83c8bf00-04c0-4b50-81e4-84ce32288bb4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:29.179125 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-83c8bf00-04c0-4b50-81e4-84ce32288bb4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:29.187919 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-83c8bf00-04c0-4b50-81e4-84ce32288bb4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1663 microversion: 2.1 time: 0.163160 Nov 21 13:55:29.198466 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 278/571] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:29 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1663 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:29.996783 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-d8435419-4d54-4156-8e85-700414c21bd6 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:29.997326 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-d8435419-4d54-4156-8e85-700414c21bd6 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:30.004063 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d8435419-4d54-4156-8e85-700414c21bd6 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:30.004519 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d8435419-4d54-4156-8e85-700414c21bd6 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:30.005311 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d8435419-4d54-4156-8e85-700414c21bd6 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:30.005752 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d8435419-4d54-4156-8e85-700414c21bd6 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:30.142505 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-d8435419-4d54-4156-8e85-700414c21bd6 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:30.152711 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-d8435419-4d54-4156-8e85-700414c21bd6 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1358 microversion: 2.1 time: 0.159604 Nov 21 13:55:30.161888 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 294/572] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:29 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:30.205372 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a07e3f78-b4d2-480c-9a2c-271f44c0b17b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:30.205987 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a07e3f78-b4d2-480c-9a2c-271f44c0b17b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:30.213184 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a07e3f78-b4d2-480c-9a2c-271f44c0b17b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:30.213638 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a07e3f78-b4d2-480c-9a2c-271f44c0b17b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:30.214417 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a07e3f78-b4d2-480c-9a2c-271f44c0b17b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:30.214855 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a07e3f78-b4d2-480c-9a2c-271f44c0b17b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:30.347960 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a07e3f78-b4d2-480c-9a2c-271f44c0b17b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:30.355667 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a07e3f78-b4d2-480c-9a2c-271f44c0b17b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1663 microversion: 2.1 time: 0.153910 Nov 21 13:55:30.356277 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 279/573] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:30 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:31.169354 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-da541011-0a33-4f92-85f4-2c1ab7e486fa tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:31.169956 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-da541011-0a33-4f92-85f4-2c1ab7e486fa tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:31.176781 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-da541011-0a33-4f92-85f4-2c1ab7e486fa tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:31.177316 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-da541011-0a33-4f92-85f4-2c1ab7e486fa tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:31.178236 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-da541011-0a33-4f92-85f4-2c1ab7e486fa tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:31.178666 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-da541011-0a33-4f92-85f4-2c1ab7e486fa tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:31.332921 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-da541011-0a33-4f92-85f4-2c1ab7e486fa tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:31.342322 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-da541011-0a33-4f92-85f4-2c1ab7e486fa tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1358 microversion: 2.1 time: 0.176543 Nov 21 13:55:31.342898 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 295/574] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:31 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:31.373129 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-1027f4ea-965b-4a08-98c7-39e9ee5ee1b3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:31.373802 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-1027f4ea-965b-4a08-98c7-39e9ee5ee1b3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:31.380532 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1027f4ea-965b-4a08-98c7-39e9ee5ee1b3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:31.381062 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1027f4ea-965b-4a08-98c7-39e9ee5ee1b3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:31.381870 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1027f4ea-965b-4a08-98c7-39e9ee5ee1b3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:31.382376 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1027f4ea-965b-4a08-98c7-39e9ee5ee1b3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:31.522246 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-1027f4ea-965b-4a08-98c7-39e9ee5ee1b3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:31.529465 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-1027f4ea-965b-4a08-98c7-39e9ee5ee1b3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1663 microversion: 2.1 time: 0.160545 Nov 21 13:55:31.530027 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 280/575] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:31 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:32.359266 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-521044cc-bfee-496f-ae8b-17fe2e3b920a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:32.359921 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-521044cc-bfee-496f-ae8b-17fe2e3b920a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:32.366209 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-521044cc-bfee-496f-ae8b-17fe2e3b920a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:32.366664 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-521044cc-bfee-496f-ae8b-17fe2e3b920a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:32.367495 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-521044cc-bfee-496f-ae8b-17fe2e3b920a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:32.368003 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-521044cc-bfee-496f-ae8b-17fe2e3b920a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:32.511431 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-521044cc-bfee-496f-ae8b-17fe2e3b920a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:32.518726 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-521044cc-bfee-496f-ae8b-17fe2e3b920a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1358 microversion: 2.1 time: 0.162917 Nov 21 13:55:32.519916 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 296/576] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:32 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:32.546286 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-9441656a-4099-467e-81f9-6663acce6e49 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:32.547495 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-9441656a-4099-467e-81f9-6663acce6e49 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:32.554128 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9441656a-4099-467e-81f9-6663acce6e49 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:32.554663 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9441656a-4099-467e-81f9-6663acce6e49 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:32.555535 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9441656a-4099-467e-81f9-6663acce6e49 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:32.556067 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9441656a-4099-467e-81f9-6663acce6e49 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:32.846374 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-9441656a-4099-467e-81f9-6663acce6e49 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:32.854110 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-9441656a-4099-467e-81f9-6663acce6e49 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1663 microversion: 2.1 time: 0.311504 Nov 21 13:55:32.854690 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 281/577] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:32 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1663 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:33.536385 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-f1c42a2e-93e7-4db9-aefe-d2a8a3b500a8 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:33.536991 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-f1c42a2e-93e7-4db9-aefe-d2a8a3b500a8 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:33.543360 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f1c42a2e-93e7-4db9-aefe-d2a8a3b500a8 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:33.543749 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f1c42a2e-93e7-4db9-aefe-d2a8a3b500a8 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:33.544552 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f1c42a2e-93e7-4db9-aefe-d2a8a3b500a8 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:33.545015 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f1c42a2e-93e7-4db9-aefe-d2a8a3b500a8 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:33.676656 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-f1c42a2e-93e7-4db9-aefe-d2a8a3b500a8 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:33.684602 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-f1c42a2e-93e7-4db9-aefe-d2a8a3b500a8 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1358 microversion: 2.1 time: 0.152412 Nov 21 13:55:33.685167 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 297/578] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:33 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:33.871907 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-7dcb70aa-8f46-46bb-9cef-ac312b9c0709 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:33.872525 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-7dcb70aa-8f46-46bb-9cef-ac312b9c0709 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:33.878674 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7dcb70aa-8f46-46bb-9cef-ac312b9c0709 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:33.879129 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7dcb70aa-8f46-46bb-9cef-ac312b9c0709 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:33.879930 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7dcb70aa-8f46-46bb-9cef-ac312b9c0709 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:33.880369 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7dcb70aa-8f46-46bb-9cef-ac312b9c0709 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:34.007815 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-7dcb70aa-8f46-46bb-9cef-ac312b9c0709 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:34.015530 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-7dcb70aa-8f46-46bb-9cef-ac312b9c0709 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1667 microversion: 2.1 time: 0.147382 Nov 21 13:55:34.016145 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 282/579] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:33 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1667 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:55:34.701646 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-7bdc1cb0-242d-4f3b-84d4-8f38f90aa644 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:34.702254 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-7bdc1cb0-242d-4f3b-84d4-8f38f90aa644 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:34.709180 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7bdc1cb0-242d-4f3b-84d4-8f38f90aa644 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:34.709626 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7bdc1cb0-242d-4f3b-84d4-8f38f90aa644 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:34.710413 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7bdc1cb0-242d-4f3b-84d4-8f38f90aa644 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:34.710825 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7bdc1cb0-242d-4f3b-84d4-8f38f90aa644 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:34.838512 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-7bdc1cb0-242d-4f3b-84d4-8f38f90aa644 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:34.845587 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-7bdc1cb0-242d-4f3b-84d4-8f38f90aa644 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1358 microversion: 2.1 time: 0.147528 Nov 21 13:55:34.846088 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 298/580] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:34 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:35.862123 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-4ed04288-ab14-4fbb-9e26-b516cafba0e1 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:35.862804 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-4ed04288-ab14-4fbb-9e26-b516cafba0e1 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:35.869144 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4ed04288-ab14-4fbb-9e26-b516cafba0e1 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:35.869596 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4ed04288-ab14-4fbb-9e26-b516cafba0e1 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:35.870402 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4ed04288-ab14-4fbb-9e26-b516cafba0e1 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:35.870836 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4ed04288-ab14-4fbb-9e26-b516cafba0e1 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:35.998116 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4ed04288-ab14-4fbb-9e26-b516cafba0e1 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:36.005919 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-4ed04288-ab14-4fbb-9e26-b516cafba0e1 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1358 microversion: 2.1 time: 0.147411 Nov 21 13:55:36.006483 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 283/581] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:35 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:37.021987 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-5b934c18-95f7-4455-9d2b-3df80b54c0a4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:37.022508 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-5b934c18-95f7-4455-9d2b-3df80b54c0a4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:37.028798 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5b934c18-95f7-4455-9d2b-3df80b54c0a4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:37.029253 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5b934c18-95f7-4455-9d2b-3df80b54c0a4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:37.030034 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5b934c18-95f7-4455-9d2b-3df80b54c0a4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:37.030468 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5b934c18-95f7-4455-9d2b-3df80b54c0a4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:37.159008 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-5b934c18-95f7-4455-9d2b-3df80b54c0a4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:37.166592 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-5b934c18-95f7-4455-9d2b-3df80b54c0a4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1358 microversion: 2.1 time: 0.148418 Nov 21 13:55:37.167153 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 299/582] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:37 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:38.183940 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-812ba67b-dd2b-48ce-9254-5be8a3667432 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:38.184551 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-812ba67b-dd2b-48ce-9254-5be8a3667432 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:38.190766 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-812ba67b-dd2b-48ce-9254-5be8a3667432 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:38.191215 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-812ba67b-dd2b-48ce-9254-5be8a3667432 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:38.192015 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-812ba67b-dd2b-48ce-9254-5be8a3667432 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:38.192456 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-812ba67b-dd2b-48ce-9254-5be8a3667432 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:38.320843 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-812ba67b-dd2b-48ce-9254-5be8a3667432 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:38.328070 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-812ba67b-dd2b-48ce-9254-5be8a3667432 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1358 microversion: 2.1 time: 0.147745 Nov 21 13:55:38.328718 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 284/583] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:38 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:38.398352 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-fc4b36c6-124c-4ee2-b966-1c79b7c2f102 req-45bfa8bc-12c7-44cd-a0ce-6c446a9fd7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b1367a1-8117-4d60-9d06-1a59f6ac647d", "name": "network-vif-plugged", "status": "completed", "tag": "0f9a92e8-efd7-45cc-b13f-25658f0506ad"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:55:38.400041 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:55:38.400041 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:55:38.407410 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-fc4b36c6-124c-4ee2-b966-1c79b7c2f102 req-45bfa8bc-12c7-44cd-a0ce-6c446a9fd7d9 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:38.407914 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-fc4b36c6-124c-4ee2-b966-1c79b7c2f102 req-45bfa8bc-12c7-44cd-a0ce-6c446a9fd7d9 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:38.419494 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-fc4b36c6-124c-4ee2-b966-1c79b7c2f102 req-45bfa8bc-12c7-44cd-a0ce-6c446a9fd7d9 service nova] Creating event network-vif-plugged:0f9a92e8-efd7-45cc-b13f-25658f0506ad for instance 9b1367a1-8117-4d60-9d06-1a59f6ac647d on hv-cinder-76845 Nov 21 13:55:38.424749 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-fc4b36c6-124c-4ee2-b966-1c79b7c2f102 req-45bfa8bc-12c7-44cd-a0ce-6c446a9fd7d9 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030033 Nov 21 13:55:38.426164 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 300/584] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:55:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:55:39.345215 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-2ac7b2cc-255c-459b-9576-b921480f5e45 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:39.345824 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-2ac7b2cc-255c-459b-9576-b921480f5e45 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:39.352104 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2ac7b2cc-255c-459b-9576-b921480f5e45 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:39.352553 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2ac7b2cc-255c-459b-9576-b921480f5e45 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:39.353321 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2ac7b2cc-255c-459b-9576-b921480f5e45 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:39.353755 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2ac7b2cc-255c-459b-9576-b921480f5e45 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:39.479270 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2ac7b2cc-255c-459b-9576-b921480f5e45 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:39.486373 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-2ac7b2cc-255c-459b-9576-b921480f5e45 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1358 microversion: 2.1 time: 0.144790 Nov 21 13:55:39.486935 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 285/585] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:39 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:40.504850 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-36ab2108-2881-4c44-aa49-61bc6619ad98 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:40.505659 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-36ab2108-2881-4c44-aa49-61bc6619ad98 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:40.511798 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-36ab2108-2881-4c44-aa49-61bc6619ad98 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:40.512263 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-36ab2108-2881-4c44-aa49-61bc6619ad98 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:40.513082 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-36ab2108-2881-4c44-aa49-61bc6619ad98 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:40.513514 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-36ab2108-2881-4c44-aa49-61bc6619ad98 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:40.660105 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-36ab2108-2881-4c44-aa49-61bc6619ad98 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:40.667577 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-36ab2108-2881-4c44-aa49-61bc6619ad98 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1547 microversion: 2.1 time: 0.168596 Nov 21 13:55:40.668185 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 301/586] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:40 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1547 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:40.683463 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-2acafa08-a817-4c2c-8635-277f5e8d6580 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:40.684100 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-2acafa08-a817-4c2c-8635-277f5e8d6580 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:40.691030 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2acafa08-a817-4c2c-8635-277f5e8d6580 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:40.691724 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2acafa08-a817-4c2c-8635-277f5e8d6580 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:40.693018 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2acafa08-a817-4c2c-8635-277f5e8d6580 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:40.694453 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2acafa08-a817-4c2c-8635-277f5e8d6580 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:40.824501 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2acafa08-a817-4c2c-8635-277f5e8d6580 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:40.837188 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-2acafa08-a817-4c2c-8635-277f5e8d6580 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1547 microversion: 2.1 time: 0.157354 Nov 21 13:55:40.838745 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 286/587] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:40 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:40.853414 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-18e4e719-dda1-4a7a-ba21-6881a734bfac tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:40.856845 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:55:40.856845 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:55:40.857848 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-18e4e719-dda1-4a7a-ba21-6881a734bfac tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:40.858624 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-18e4e719-dda1-4a7a-ba21-6881a734bfac tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Searching by: {'deleted': False, 'project_id': '406bef8592334a749f671da6881b0cf5'} {{(pid=122564) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 21 13:55:40.865177 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-18e4e719-dda1-4a7a-ba21-6881a734bfac tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:40.865625 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-18e4e719-dda1-4a7a-ba21-6881a734bfac tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:40.866429 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-18e4e719-dda1-4a7a-ba21-6881a734bfac tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:40.866869 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-18e4e719-dda1-4a7a-ba21-6881a734bfac tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:40.953775 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.multi_cell_list [None req-18e4e719-dda1-4a7a-ba21-6881a734bfac tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122564) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 21 13:55:41.042950 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-18e4e719-dda1-4a7a-ba21-6881a734bfac tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.193007 Nov 21 13:55:41.043456 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 302/588] 10.222.0.11 () {58 vars in 1124 bytes} [Sun Nov 21 13:55:40 2021] GET /compute/v2.1/servers => generated 343 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:55:41.053809 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-4fe01e53-b4bc-4a73-aa4c-670a19d58f10 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:41.054425 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-4fe01e53-b4bc-4a73-aa4c-670a19d58f10 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:41.060262 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4fe01e53-b4bc-4a73-aa4c-670a19d58f10 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:41.060710 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4fe01e53-b4bc-4a73-aa4c-670a19d58f10 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:41.061491 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4fe01e53-b4bc-4a73-aa4c-670a19d58f10 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:41.061957 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4fe01e53-b4bc-4a73-aa4c-670a19d58f10 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:41.192018 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4fe01e53-b4bc-4a73-aa4c-670a19d58f10 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:41.199167 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-4fe01e53-b4bc-4a73-aa4c-670a19d58f10 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1547 microversion: 2.1 time: 0.149477 Nov 21 13:55:41.199728 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 287/589] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:41 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:42.872653 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-4b42dcee-4807-4ac4-b6a5-440c746f2c59 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6961d90f-f3b7-42cf-b099-6a88939fce89"}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:55:42.873712 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-4b42dcee-4807-4ac4-b6a5-440c746f2c59 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:42.880525 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4b42dcee-4807-4ac4-b6a5-440c746f2c59 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:42.880985 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4b42dcee-4807-4ac4-b6a5-440c746f2c59 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:42.881770 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4b42dcee-4807-4ac4-b6a5-440c746f2c59 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:42.882215 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4b42dcee-4807-4ac4-b6a5-440c746f2c59 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:43.118850 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-4b42dcee-4807-4ac4-b6a5-440c746f2c59 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "POST /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249887 Nov 21 13:55:43.119686 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 303/590] 10.222.0.11 () {60 vars in 1322 bytes} [Sun Nov 21 13:55:42 2021] POST /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:55:43.479756 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-60bdde73-05d7-406a-89b8-3116156b7c01 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:43.480666 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-60bdde73-05d7-406a-89b8-3116156b7c01 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:43.488187 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-60bdde73-05d7-406a-89b8-3116156b7c01 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:43.488575 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-60bdde73-05d7-406a-89b8-3116156b7c01 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:43.489362 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-60bdde73-05d7-406a-89b8-3116156b7c01 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:43.489855 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-60bdde73-05d7-406a-89b8-3116156b7c01 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:43.521808 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-60bdde73-05d7-406a-89b8-3116156b7c01 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments/006ee4ac-afbc-43ee-a3e9-7c1792bda56e" status: 200 len: 194 microversion: 2.20 time: 0.046165 Nov 21 13:55:43.522451 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 288/591] 10.222.0.11 () {60 vars in 1453 bytes} [Sun Nov 21 13:55:43 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments/006ee4ac-afbc-43ee-a3e9-7c1792bda56e => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:55:43.587696 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-0ba8d778-f94e-4386-9ab8-31678dfcfe8c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:43.588626 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-0ba8d778-f94e-4386-9ab8-31678dfcfe8c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:43.595210 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0ba8d778-f94e-4386-9ab8-31678dfcfe8c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:43.595655 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0ba8d778-f94e-4386-9ab8-31678dfcfe8c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:43.596466 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0ba8d778-f94e-4386-9ab8-31678dfcfe8c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:43.597334 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0ba8d778-f94e-4386-9ab8-31678dfcfe8c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:43.679442 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.objects.instance [None req-0ba8d778-f94e-4386-9ab8-31678dfcfe8c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lazy-loading 'services' on Instance uuid 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 {{(pid=122564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:55:43.748787 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-0ba8d778-f94e-4386-9ab8-31678dfcfe8c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "DELETE /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments/006ee4ac-afbc-43ee-a3e9-7c1792bda56e" status: 202 len: 0 microversion: 2.20 time: 0.165649 Nov 21 13:55:43.749377 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 304/592] 10.222.0.11 () {60 vars in 1456 bytes} [Sun Nov 21 13:55:43 2021] DELETE /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments/006ee4ac-afbc-43ee-a3e9-7c1792bda56e => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 21 13:55:43.758195 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-555443f6-9110-4d68-ae40-64ed8ccf4a46 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:43.759144 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-555443f6-9110-4d68-ae40-64ed8ccf4a46 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:43.765008 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-555443f6-9110-4d68-ae40-64ed8ccf4a46 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:43.765463 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-555443f6-9110-4d68-ae40-64ed8ccf4a46 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:43.766401 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-555443f6-9110-4d68-ae40-64ed8ccf4a46 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:43.766851 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-555443f6-9110-4d68-ae40-64ed8ccf4a46 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:43.800525 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-555443f6-9110-4d68-ae40-64ed8ccf4a46 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045644 Nov 21 13:55:43.804683 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 289/593] 10.222.0.11 () {60 vars in 1342 bytes} [Sun Nov 21 13:55:43 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:55:44.812081 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-8396d1f4-24d4-432a-92b3-f9b94abc826f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:44.813176 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-8396d1f4-24d4-432a-92b3-f9b94abc826f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:44.819666 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8396d1f4-24d4-432a-92b3-f9b94abc826f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:44.820292 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8396d1f4-24d4-432a-92b3-f9b94abc826f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:44.821496 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8396d1f4-24d4-432a-92b3-f9b94abc826f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:44.822232 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8396d1f4-24d4-432a-92b3-f9b94abc826f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:44.853288 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-8396d1f4-24d4-432a-92b3-f9b94abc826f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045412 Nov 21 13:55:44.853959 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 305/594] 10.222.0.11 () {60 vars in 1342 bytes} [Sun Nov 21 13:55:44 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:55:45.866299 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-21f0fa89-57f4-44da-9e4a-404a4e59b4e3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:45.867447 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-21f0fa89-57f4-44da-9e4a-404a4e59b4e3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:45.873930 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-21f0fa89-57f4-44da-9e4a-404a4e59b4e3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:45.874384 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-21f0fa89-57f4-44da-9e4a-404a4e59b4e3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:45.875164 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-21f0fa89-57f4-44da-9e4a-404a4e59b4e3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:45.875907 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-21f0fa89-57f4-44da-9e4a-404a4e59b4e3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:45.906139 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-21f0fa89-57f4-44da-9e4a-404a4e59b4e3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044283 Nov 21 13:55:45.906690 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 290/595] 10.222.0.11 () {60 vars in 1342 bytes} [Sun Nov 21 13:55:45 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:55:46.918252 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-1b71fa94-1578-4cff-8d52-78871bb90341 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:46.919217 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-1b71fa94-1578-4cff-8d52-78871bb90341 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:46.926023 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1b71fa94-1578-4cff-8d52-78871bb90341 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:46.926474 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1b71fa94-1578-4cff-8d52-78871bb90341 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:46.927257 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1b71fa94-1578-4cff-8d52-78871bb90341 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:46.927691 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1b71fa94-1578-4cff-8d52-78871bb90341 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:46.956124 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-1b71fa94-1578-4cff-8d52-78871bb90341 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041682 Nov 21 13:55:46.956675 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 306/596] 10.222.0.11 () {60 vars in 1342 bytes} [Sun Nov 21 13:55:46 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 13:55:47.966998 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-1b8d845d-3cb8-4f3b-bd48-37e8b6da1873 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:47.967934 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-1b8d845d-3cb8-4f3b-bd48-37e8b6da1873 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:47.974070 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1b8d845d-3cb8-4f3b-bd48-37e8b6da1873 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:47.974516 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1b8d845d-3cb8-4f3b-bd48-37e8b6da1873 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:47.975285 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1b8d845d-3cb8-4f3b-bd48-37e8b6da1873 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:47.975716 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1b8d845d-3cb8-4f3b-bd48-37e8b6da1873 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:48.005305 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-1b8d845d-3cb8-4f3b-bd48-37e8b6da1873 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042085 Nov 21 13:55:48.005840 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 291/597] 10.222.0.11 () {60 vars in 1342 bytes} [Sun Nov 21 13:55:47 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:55:49.016685 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-71d4b74d-687d-41b1-9ccb-440baa81907b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:49.017590 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-71d4b74d-687d-41b1-9ccb-440baa81907b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:49.023941 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-71d4b74d-687d-41b1-9ccb-440baa81907b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:49.024396 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-71d4b74d-687d-41b1-9ccb-440baa81907b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:49.025170 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-71d4b74d-687d-41b1-9ccb-440baa81907b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:49.025602 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-71d4b74d-687d-41b1-9ccb-440baa81907b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:49.054260 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-71d4b74d-687d-41b1-9ccb-440baa81907b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041409 Nov 21 13:55:49.054805 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 307/598] 10.222.0.11 () {60 vars in 1342 bytes} [Sun Nov 21 13:55:49 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:55:50.066382 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-1f3f7ad1-1ab8-44a5-9267-2712e88ab1cd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:50.067314 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-1f3f7ad1-1ab8-44a5-9267-2712e88ab1cd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:50.073575 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1f3f7ad1-1ab8-44a5-9267-2712e88ab1cd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:50.074021 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1f3f7ad1-1ab8-44a5-9267-2712e88ab1cd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:50.074794 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1f3f7ad1-1ab8-44a5-9267-2712e88ab1cd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:50.078474 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1f3f7ad1-1ab8-44a5-9267-2712e88ab1cd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:50.109443 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-1f3f7ad1-1ab8-44a5-9267-2712e88ab1cd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046712 Nov 21 13:55:50.110008 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 292/599] 10.222.0.11 () {60 vars in 1342 bytes} [Sun Nov 21 13:55:50 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:55:51.120724 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2b9ea2fe-b33c-495c-91b4-0cc7a5ca7830 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:51.121631 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-2b9ea2fe-b33c-495c-91b4-0cc7a5ca7830 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:51.128727 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2b9ea2fe-b33c-495c-91b4-0cc7a5ca7830 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:51.129176 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2b9ea2fe-b33c-495c-91b4-0cc7a5ca7830 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:51.129947 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2b9ea2fe-b33c-495c-91b4-0cc7a5ca7830 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:51.130380 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2b9ea2fe-b33c-495c-91b4-0cc7a5ca7830 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:51.157829 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-2b9ea2fe-b33c-495c-91b4-0cc7a5ca7830 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040880 Nov 21 13:55:51.158367 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 308/600] 10.222.0.11 () {60 vars in 1342 bytes} [Sun Nov 21 13:55:51 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:55:51.685586 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-173d74f4-3c70-4b0d-a01e-717054db805a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:51.686207 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-173d74f4-3c70-4b0d-a01e-717054db805a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:51.692495 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-173d74f4-3c70-4b0d-a01e-717054db805a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:51.693142 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-173d74f4-3c70-4b0d-a01e-717054db805a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:51.693930 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-173d74f4-3c70-4b0d-a01e-717054db805a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:51.694369 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-173d74f4-3c70-4b0d-a01e-717054db805a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:51.825674 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-173d74f4-3c70-4b0d-a01e-717054db805a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:51.833982 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-173d74f4-3c70-4b0d-a01e-717054db805a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1593 microversion: 2.1 time: 0.151929 Nov 21 13:55:51.834547 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 293/601] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:51 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1593 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:52.169764 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-4673af24-de50-46f0-bfc6-088437554c10 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:52.170682 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-4673af24-de50-46f0-bfc6-088437554c10 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:52.176927 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4673af24-de50-46f0-bfc6-088437554c10 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:52.177379 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4673af24-de50-46f0-bfc6-088437554c10 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:52.178161 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4673af24-de50-46f0-bfc6-088437554c10 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:52.178594 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4673af24-de50-46f0-bfc6-088437554c10 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:52.207390 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-4673af24-de50-46f0-bfc6-088437554c10 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041380 Nov 21 13:55:52.207975 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 309/602] 10.222.0.11 () {60 vars in 1342 bytes} [Sun Nov 21 13:55:52 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:52.271480 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-739bf487-8e38-49c9-8f3a-c686221ea0cb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:52.277970 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-739bf487-8e38-49c9-8f3a-c686221ea0cb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:52.284488 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-739bf487-8e38-49c9-8f3a-c686221ea0cb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:52.284934 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-739bf487-8e38-49c9-8f3a-c686221ea0cb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:52.285720 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-739bf487-8e38-49c9-8f3a-c686221ea0cb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:52.286353 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-739bf487-8e38-49c9-8f3a-c686221ea0cb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:52.311325 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-739bf487-8e38-49c9-8f3a-c686221ea0cb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Going to try to terminate instance {{(pid=122565) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 21 13:55:52.391920 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-739bf487-8e38-49c9-8f3a-c686221ea0cb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "DELETE /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 204 len: 0 microversion: 2.20 time: 0.124481 Nov 21 13:55:52.393017 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 294/603] 10.222.0.11 () {60 vars in 1279 bytes} [Sun Nov 21 13:55:52 2021] DELETE /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 21 13:55:52.401302 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-425b7ef3-ec0c-4a0b-9d98-ef9f98d534c9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:52.402154 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-425b7ef3-ec0c-4a0b-9d98-ef9f98d534c9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:52.408448 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-425b7ef3-ec0c-4a0b-9d98-ef9f98d534c9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:52.409023 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-425b7ef3-ec0c-4a0b-9d98-ef9f98d534c9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:52.410019 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-425b7ef3-ec0c-4a0b-9d98-ef9f98d534c9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:52.410460 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-425b7ef3-ec0c-4a0b-9d98-ef9f98d534c9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:52.554142 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-425b7ef3-ec0c-4a0b-9d98-ef9f98d534c9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:52.562245 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-425b7ef3-ec0c-4a0b-9d98-ef9f98d534c9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:52.563751 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-425b7ef3-ec0c-4a0b-9d98-ef9f98d534c9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:52.564946 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-425b7ef3-ec0c-4a0b-9d98-ef9f98d534c9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.167399 Nov 21 13:55:52.566359 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 310/604] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:55:52 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:55:53.585270 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-8541a54f-3d87-49e1-88a7-18629d2ed2dc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:53.585967 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-8541a54f-3d87-49e1-88a7-18629d2ed2dc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:53.592334 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8541a54f-3d87-49e1-88a7-18629d2ed2dc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:53.592792 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8541a54f-3d87-49e1-88a7-18629d2ed2dc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:53.593575 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8541a54f-3d87-49e1-88a7-18629d2ed2dc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:53.594014 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8541a54f-3d87-49e1-88a7-18629d2ed2dc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:53.869358 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-8541a54f-3d87-49e1-88a7-18629d2ed2dc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:53.877473 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-8541a54f-3d87-49e1-88a7-18629d2ed2dc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:53.879577 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-8541a54f-3d87-49e1-88a7-18629d2ed2dc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:53.880829 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-8541a54f-3d87-49e1-88a7-18629d2ed2dc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.300264 Nov 21 13:55:53.881397 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 295/605] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:55:53 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:55:53.982742 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-f176665b-668a-4212-af16-50c7d9a60dcb req-5c96d005-8ae0-4cc0-9814-049127b2fa5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b1367a1-8117-4d60-9d06-1a59f6ac647d", "tag": "0f9a92e8-efd7-45cc-b13f-25658f0506ad"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:55:53.984341 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:55:53.984341 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:55:53.992625 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-f176665b-668a-4212-af16-50c7d9a60dcb req-5c96d005-8ae0-4cc0-9814-049127b2fa5e service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:53.993188 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-f176665b-668a-4212-af16-50c7d9a60dcb req-5c96d005-8ae0-4cc0-9814-049127b2fa5e service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:54.009343 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-f176665b-668a-4212-af16-50c7d9a60dcb req-5c96d005-8ae0-4cc0-9814-049127b2fa5e service nova] Creating event network-changed:0f9a92e8-efd7-45cc-b13f-25658f0506ad for instance 9b1367a1-8117-4d60-9d06-1a59f6ac647d on hv-cinder-76845 Nov 21 13:55:54.016507 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-f176665b-668a-4212-af16-50c7d9a60dcb req-5c96d005-8ae0-4cc0-9814-049127b2fa5e service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037210 Nov 21 13:55:54.017662 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 311/606] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:55:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:55:54.909438 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-1c615d89-2130-405e-ba3a-415233d5e210 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:54.912913 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-1c615d89-2130-405e-ba3a-415233d5e210 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:54.945400 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1c615d89-2130-405e-ba3a-415233d5e210 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:54.946520 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1c615d89-2130-405e-ba3a-415233d5e210 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:54.947590 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1c615d89-2130-405e-ba3a-415233d5e210 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:54.948274 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1c615d89-2130-405e-ba3a-415233d5e210 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:55.266978 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-1c615d89-2130-405e-ba3a-415233d5e210 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:55.280986 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-1c615d89-2130-405e-ba3a-415233d5e210 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:55.282601 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-1c615d89-2130-405e-ba3a-415233d5e210 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:55.286950 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-1c615d89-2130-405e-ba3a-415233d5e210 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1725 microversion: 2.20 time: 0.389049 Nov 21 13:55:55.286950 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 296/607] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:55:54 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1725 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:55:55.450695 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-57763e44-586e-4061-9c3e-6cfc0189f5a5 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-858840109"}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:55:55.452006 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-57763e44-586e-4061-9c3e-6cfc0189f5a5 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:55.460104 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-57763e44-586e-4061-9c3e-6cfc0189f5a5 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:55.460893 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-57763e44-586e-4061-9c3e-6cfc0189f5a5 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:55.463569 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-57763e44-586e-4061-9c3e-6cfc0189f5a5 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:55.464284 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-57763e44-586e-4061-9c3e-6cfc0189f5a5 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:55.624447 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.network.security_group_api [None req-57763e44-586e-4061-9c3e-6cfc0189f5a5 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Adding security group 42126e3d-39be-4ee1-969d-6af11887f875 to port 0f9a92e8-efd7-45cc-b13f-25658f0506ad Nov 21 13:55:56.052059 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-57763e44-586e-4061-9c3e-6cfc0189f5a5 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "POST /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/action" status: 202 len: 0 microversion: 2.1 time: 0.605065 Nov 21 13:55:56.052674 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 312/608] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:55:55 2021] POST /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:55:56.066906 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-2963af1f-c2b6-4dc4-a6d3-32ddd2def3c7 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:56.068253 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-2963af1f-c2b6-4dc4-a6d3-32ddd2def3c7 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:56.075418 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-48bee2bb-b76d-41ae-b5a9-2d0f95a56832 req-04f4b83c-b9b3-4c69-85d4-8852be6cc357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b1367a1-8117-4d60-9d06-1a59f6ac647d", "tag": "0f9a92e8-efd7-45cc-b13f-25658f0506ad"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:55:56.089436 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:55:56.089436 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:55:56.094469 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2963af1f-c2b6-4dc4-a6d3-32ddd2def3c7 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:56.094922 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2963af1f-c2b6-4dc4-a6d3-32ddd2def3c7 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:56.095965 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2963af1f-c2b6-4dc4-a6d3-32ddd2def3c7 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:56.096437 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2963af1f-c2b6-4dc4-a6d3-32ddd2def3c7 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:56.104027 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-48bee2bb-b76d-41ae-b5a9-2d0f95a56832 req-04f4b83c-b9b3-4c69-85d4-8852be6cc357 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:56.104735 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-48bee2bb-b76d-41ae-b5a9-2d0f95a56832 req-04f4b83c-b9b3-4c69-85d4-8852be6cc357 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:56.134095 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-48bee2bb-b76d-41ae-b5a9-2d0f95a56832 req-04f4b83c-b9b3-4c69-85d4-8852be6cc357 service nova] Creating event network-changed:0f9a92e8-efd7-45cc-b13f-25658f0506ad for instance 9b1367a1-8117-4d60-9d06-1a59f6ac647d on hv-cinder-76845 Nov 21 13:55:56.146973 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-48bee2bb-b76d-41ae-b5a9-2d0f95a56832 req-04f4b83c-b9b3-4c69-85d4-8852be6cc357 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082672 Nov 21 13:55:56.154407 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 313/609] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:55:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:55:56.309468 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-fe7b2ce1-d5aa-46ea-b401-2a5f92884ba9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:56.322334 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-fe7b2ce1-d5aa-46ea-b401-2a5f92884ba9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:56.344564 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fe7b2ce1-d5aa-46ea-b401-2a5f92884ba9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:56.346086 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fe7b2ce1-d5aa-46ea-b401-2a5f92884ba9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:56.347722 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fe7b2ce1-d5aa-46ea-b401-2a5f92884ba9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:56.353123 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fe7b2ce1-d5aa-46ea-b401-2a5f92884ba9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:56.446367 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-fe7b2ce1-d5aa-46ea-b401-2a5f92884ba9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:56.454340 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-fe7b2ce1-d5aa-46ea-b401-2a5f92884ba9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:56.457919 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-fe7b2ce1-d5aa-46ea-b401-2a5f92884ba9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:56.459455 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-fe7b2ce1-d5aa-46ea-b401-2a5f92884ba9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 200 len: 1366 microversion: 2.20 time: 0.158067 Nov 21 13:55:56.460354 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 314/610] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:55:56 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 13:55:56.466091 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-f866bca1-a794-4575-a198-a9186d091765 req-efb0798f-15e1-4b13-80aa-bea8c0ece5ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e92c59-3be1-41c7-8ea1-b1bb65cf39c1", "name": "network-vif-deleted", "tag": "627d561d-d2ff-449e-a99f-9e5e3fd874ba"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:55:56.468034 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:55:56.468034 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:55:56.479135 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-f866bca1-a794-4575-a198-a9186d091765 req-efb0798f-15e1-4b13-80aa-bea8c0ece5ca service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:56.479713 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-f866bca1-a794-4575-a198-a9186d091765 req-efb0798f-15e1-4b13-80aa-bea8c0ece5ca service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:56.495681 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-f866bca1-a794-4575-a198-a9186d091765 req-efb0798f-15e1-4b13-80aa-bea8c0ece5ca service nova] Creating event network-vif-deleted:627d561d-d2ff-449e-a99f-9e5e3fd874ba for instance 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 on hv-cinder-76845 Nov 21 13:55:56.502663 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-f866bca1-a794-4575-a198-a9186d091765 req-efb0798f-15e1-4b13-80aa-bea8c0ece5ca service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040343 Nov 21 13:55:56.504599 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 315/611] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:55:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:55:56.527777 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2963af1f-c2b6-4dc4-a6d3-32ddd2def3c7 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:55:56.542095 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-2963af1f-c2b6-4dc4-a6d3-32ddd2def3c7 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1757 microversion: 2.1 time: 0.483283 Nov 21 13:55:56.543039 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 297/612] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:55:56 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1757 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:55:57.480998 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-e9a6933d-bf7d-44d9-be79-8a06deab43fa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:57.482127 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-e9a6933d-bf7d-44d9-be79-8a06deab43fa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:55:57.492402 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e9a6933d-bf7d-44d9-be79-8a06deab43fa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:57.493673 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e9a6933d-bf7d-44d9-be79-8a06deab43fa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:57.494640 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e9a6933d-bf7d-44d9-be79-8a06deab43fa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:55:57.495157 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e9a6933d-bf7d-44d9-be79-8a06deab43fa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:55:57.515939 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.wsgi [None req-e9a6933d-bf7d-44d9-be79-8a06deab43fa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] HTTP exception thrown: Instance 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 could not be found. Nov 21 13:55:57.516797 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-e9a6933d-bf7d-44d9-be79-8a06deab43fa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Returning 404 to user: Instance 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 could not be found. {{(pid=122564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:55:57.519394 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-e9a6933d-bf7d-44d9-be79-8a06deab43fa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 404 len: 111 microversion: 2.20 time: 0.043851 Nov 21 13:55:57.520712 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 316/613] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:55:57 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 21 13:55:57.530665 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-dacbedbc-215a-4349-b79e-f5029e0634dc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '.version_select at 0x7fd5135e11f0>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:55:57.557526 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-dacbedbc-215a-4349-b79e-f5029e0634dc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2038718668" status: 204 len: 0 microversion: 2.20 time: 0.032383 Nov 21 13:55:57.558811 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 298/614] 10.222.0.11 () {60 vars in 1261 bytes} [Sun Nov 21 13:55:57 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2038718668 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 21 13:55:58.331781 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-e0134307-b9ae-451d-9658-3fff0c68f91c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'create', calling method: .version_select at 0x7fd513d599d0>, body: {"keypair": {"name": "tempest-keypair-1647900985"}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:55:58.350983 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-e0134307-b9ae-451d-9658-3fff0c68f91c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Getting quotas for project 3d25ecbdc2ba435488271022d897a406. Resources: {'key_pairs'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:55:58.355929 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-e0134307-b9ae-451d-9658-3fff0c68f91c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Getting quotas for user 67da79fc92074be09b188b5ba9edd098 and project 3d25ecbdc2ba435488271022d897a406. Resources: {'key_pairs'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:55:58.497247 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-e0134307-b9ae-451d-9658-3fff0c68f91c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Getting quotas for project 3d25ecbdc2ba435488271022d897a406. Resources: {'key_pairs'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:55:58.501320 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-e0134307-b9ae-451d-9658-3fff0c68f91c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Getting quotas for user 67da79fc92074be09b188b5ba9edd098 and project 3d25ecbdc2ba435488271022d897a406. Resources: {'key_pairs'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:55:58.513812 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-e0134307-b9ae-451d-9658-3fff0c68f91c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.186358 Nov 21 13:55:58.514340 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 317/615] 10.222.0.11 () {62 vars in 1198 bytes} [Sun Nov 21 13:55:58 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 187 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 21 13:55:59.770221 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-227f7a51-aa5c-4603-a8d1-2050f493e42c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1201461880", "imageRef": "acdb574e-2ba9-4029-849b-377b4d5722ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24c864ef-5c5a-4df8-8968-78a7fe30b188"}], "security_groups": [{"name": "tempest-securitygroup--1011287868"}], "key_name": "tempest-keypair-1647900985", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:55:59.872610 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.network.neutron [None req-227f7a51-aa5c-4603-a8d1-2050f493e42c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] validate_networks() for [('24c864ef-5c5a-4df8-8968-78a7fe30b188', None, None, None, None, None)] {{(pid=122565) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 21 13:56:00.251006 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-227f7a51-aa5c-4603-a8d1-2050f493e42c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Flavor limits 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 13:56:00.251456 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-227f7a51-aa5c-4603-a8d1-2050f493e42c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Image limits 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 13:56:00.251975 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-227f7a51-aa5c-4603-a8d1-2050f493e42c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Flavor pref 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 13:56:00.252944 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-227f7a51-aa5c-4603-a8d1-2050f493e42c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Image pref 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 13:56:00.253393 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-227f7a51-aa5c-4603-a8d1-2050f493e42c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 13:56:00.261858 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-227f7a51-aa5c-4603-a8d1-2050f493e42c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:00.262305 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-227f7a51-aa5c-4603-a8d1-2050f493e42c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:00.263142 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-227f7a51-aa5c-4603-a8d1-2050f493e42c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:00.263582 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-227f7a51-aa5c-4603-a8d1-2050f493e42c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:00.279971 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-227f7a51-aa5c-4603-a8d1-2050f493e42c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Getting quotas for project 3d25ecbdc2ba435488271022d897a406. Resources: {'instances', 'ram', 'cores'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:56:00.283865 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-227f7a51-aa5c-4603-a8d1-2050f493e42c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Getting quotas for user 67da79fc92074be09b188b5ba9edd098 and project 3d25ecbdc2ba435488271022d897a406. Resources: {'instances', 'ram', 'cores'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:56:00.294487 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-227f7a51-aa5c-4603-a8d1-2050f493e42c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Going to run 1 instances... {{(pid=122565) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 13:56:00.296841 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-227f7a51-aa5c-4603-a8d1-2050f493e42c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='acdb574e-2ba9-4029-849b-377b4d5722ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 13:56:00.340399 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-227f7a51-aa5c-4603-a8d1-2050f493e42c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.575272 Nov 21 13:56:00.341047 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 299/616] 10.222.0.11 () {62 vars in 1187 bytes} [Sun Nov 21 13:55:59 2021] POST /compute/v2.1/servers => generated 402 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 21 13:56:00.350740 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-185b8898-d4c0-490a-99ee-4b66829708a8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:00.351370 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-185b8898-d4c0-490a-99ee-4b66829708a8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:00.404319 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-185b8898-d4c0-490a-99ee-4b66829708a8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:00.411418 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-185b8898-d4c0-490a-99ee-4b66829708a8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:00.412951 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-185b8898-d4c0-490a-99ee-4b66829708a8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:00.414057 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-185b8898-d4c0-490a-99ee-4b66829708a8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1282 microversion: 2.20 time: 0.067023 Nov 21 13:56:00.414654 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 318/617] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:56:00 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1282 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:56:01.432229 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-3e063415-c0cb-4aac-876c-3266a16cf491 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:01.433535 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-3e063415-c0cb-4aac-876c-3266a16cf491 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:01.440551 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3e063415-c0cb-4aac-876c-3266a16cf491 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:01.441083 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3e063415-c0cb-4aac-876c-3266a16cf491 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:01.441947 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3e063415-c0cb-4aac-876c-3266a16cf491 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:01.442453 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3e063415-c0cb-4aac-876c-3266a16cf491 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:01.534655 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-3e063415-c0cb-4aac-876c-3266a16cf491 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:01.542496 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-3e063415-c0cb-4aac-876c-3266a16cf491 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:01.544067 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-3e063415-c0cb-4aac-876c-3266a16cf491 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:01.545166 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-3e063415-c0cb-4aac-876c-3266a16cf491 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1340 microversion: 2.20 time: 0.117134 Nov 21 13:56:01.545721 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 300/618] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:56:01 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1340 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:56:02.563588 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-55d6c70f-14d6-422d-a3b9-989c9f303730 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:02.565157 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-55d6c70f-14d6-422d-a3b9-989c9f303730 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:02.571731 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-55d6c70f-14d6-422d-a3b9-989c9f303730 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:02.572386 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-55d6c70f-14d6-422d-a3b9-989c9f303730 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:02.573365 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-55d6c70f-14d6-422d-a3b9-989c9f303730 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:02.574052 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-55d6c70f-14d6-422d-a3b9-989c9f303730 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:02.761061 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-55d6c70f-14d6-422d-a3b9-989c9f303730 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:02.772624 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-55d6c70f-14d6-422d-a3b9-989c9f303730 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:02.774421 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-55d6c70f-14d6-422d-a3b9-989c9f303730 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:02.776139 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-55d6c70f-14d6-422d-a3b9-989c9f303730 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1408 microversion: 2.20 time: 0.217215 Nov 21 13:56:02.789149 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 319/619] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:56:02 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:56:02.897651 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-b6c7f754-02c6-4f60-8a88-e7854a060f03 req-75dbce19-5b90-48a5-aee2-cdee6964e5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e70a1a57-c34e-418a-b973-e938389a3fa2", "tag": "73851145-2483-4c28-bf3b-f049e97c28cc"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:02.899229 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:56:02.899229 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:56:02.906550 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-b6c7f754-02c6-4f60-8a88-e7854a060f03 req-75dbce19-5b90-48a5-aee2-cdee6964e5c5 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:02.906998 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-b6c7f754-02c6-4f60-8a88-e7854a060f03 req-75dbce19-5b90-48a5-aee2-cdee6964e5c5 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:02.923787 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-b6c7f754-02c6-4f60-8a88-e7854a060f03 req-75dbce19-5b90-48a5-aee2-cdee6964e5c5 service nova] Creating event network-changed:73851145-2483-4c28-bf3b-f049e97c28cc for instance e70a1a57-c34e-418a-b973-e938389a3fa2 on hv-cinder-76845 Nov 21 13:56:02.933052 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-b6c7f754-02c6-4f60-8a88-e7854a060f03 req-75dbce19-5b90-48a5-aee2-cdee6964e5c5 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039519 Nov 21 13:56:02.933947 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 301/620] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:56:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:56:03.795032 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-4b968e2f-756a-4a06-8a95-d71ae0dc8875 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:03.795644 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-4b968e2f-756a-4a06-8a95-d71ae0dc8875 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:03.802664 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4b968e2f-756a-4a06-8a95-d71ae0dc8875 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:03.803117 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4b968e2f-756a-4a06-8a95-d71ae0dc8875 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:03.803948 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4b968e2f-756a-4a06-8a95-d71ae0dc8875 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:03.804390 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4b968e2f-756a-4a06-8a95-d71ae0dc8875 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:03.956401 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-4b968e2f-756a-4a06-8a95-d71ae0dc8875 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:03.965854 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-4b968e2f-756a-4a06-8a95-d71ae0dc8875 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:03.967739 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-4b968e2f-756a-4a06-8a95-d71ae0dc8875 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:03.968914 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-4b968e2f-756a-4a06-8a95-d71ae0dc8875 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1408 microversion: 2.20 time: 0.177511 Nov 21 13:56:03.980483 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 320/621] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:56:03 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:56:04.989116 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-3a7247c5-4a84-405f-9b12-7b51a3d0efbe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:04.989729 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-3a7247c5-4a84-405f-9b12-7b51a3d0efbe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:04.995868 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3a7247c5-4a84-405f-9b12-7b51a3d0efbe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:04.996326 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3a7247c5-4a84-405f-9b12-7b51a3d0efbe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:04.997106 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3a7247c5-4a84-405f-9b12-7b51a3d0efbe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:04.997549 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3a7247c5-4a84-405f-9b12-7b51a3d0efbe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:05.131496 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-3a7247c5-4a84-405f-9b12-7b51a3d0efbe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:05.139495 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-3a7247c5-4a84-405f-9b12-7b51a3d0efbe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:05.141134 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-3a7247c5-4a84-405f-9b12-7b51a3d0efbe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:05.142234 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-3a7247c5-4a84-405f-9b12-7b51a3d0efbe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1408 microversion: 2.20 time: 0.158372 Nov 21 13:56:05.142792 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 302/622] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:56:04 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:56:06.160641 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b0530094-c1a1-4260-bd2a-bd5cef184924 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:06.161155 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b0530094-c1a1-4260-bd2a-bd5cef184924 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:06.167397 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b0530094-c1a1-4260-bd2a-bd5cef184924 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:06.167877 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b0530094-c1a1-4260-bd2a-bd5cef184924 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:06.168658 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b0530094-c1a1-4260-bd2a-bd5cef184924 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:06.169097 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b0530094-c1a1-4260-bd2a-bd5cef184924 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:06.298968 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-b0530094-c1a1-4260-bd2a-bd5cef184924 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:06.307205 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-b0530094-c1a1-4260-bd2a-bd5cef184924 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:06.308725 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-b0530094-c1a1-4260-bd2a-bd5cef184924 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:06.309816 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-b0530094-c1a1-4260-bd2a-bd5cef184924 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1408 microversion: 2.20 time: 0.153519 Nov 21 13:56:06.310362 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 321/623] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:56:06 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:56:07.327482 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-1893ea84-23ef-488b-92f0-9fcc0cbf9ff5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:07.328131 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-1893ea84-23ef-488b-92f0-9fcc0cbf9ff5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:07.334469 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1893ea84-23ef-488b-92f0-9fcc0cbf9ff5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:07.334918 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1893ea84-23ef-488b-92f0-9fcc0cbf9ff5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:07.335693 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1893ea84-23ef-488b-92f0-9fcc0cbf9ff5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:07.336155 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1893ea84-23ef-488b-92f0-9fcc0cbf9ff5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:07.466717 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-1893ea84-23ef-488b-92f0-9fcc0cbf9ff5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:07.474477 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-1893ea84-23ef-488b-92f0-9fcc0cbf9ff5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:07.476062 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-1893ea84-23ef-488b-92f0-9fcc0cbf9ff5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:07.477158 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-1893ea84-23ef-488b-92f0-9fcc0cbf9ff5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1408 microversion: 2.20 time: 0.153384 Nov 21 13:56:07.477718 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 303/624] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:56:07 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:56:08.495080 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-4afeeaf8-6d04-49b8-9814-b02b7292f9d2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:08.495622 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-4afeeaf8-6d04-49b8-9814-b02b7292f9d2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:08.502240 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4afeeaf8-6d04-49b8-9814-b02b7292f9d2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:08.502683 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4afeeaf8-6d04-49b8-9814-b02b7292f9d2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:08.503450 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4afeeaf8-6d04-49b8-9814-b02b7292f9d2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:08.503910 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4afeeaf8-6d04-49b8-9814-b02b7292f9d2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:08.630553 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-4afeeaf8-6d04-49b8-9814-b02b7292f9d2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:08.638232 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-4afeeaf8-6d04-49b8-9814-b02b7292f9d2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:08.639730 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-4afeeaf8-6d04-49b8-9814-b02b7292f9d2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:08.640879 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-4afeeaf8-6d04-49b8-9814-b02b7292f9d2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1408 microversion: 2.20 time: 0.149602 Nov 21 13:56:08.641431 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 322/625] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:56:08 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:56:09.658083 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-bbea4048-c325-4ee9-ae6a-4d4fb13a62bb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:09.658861 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-bbea4048-c325-4ee9-ae6a-4d4fb13a62bb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:09.665498 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bbea4048-c325-4ee9-ae6a-4d4fb13a62bb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:09.665953 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bbea4048-c325-4ee9-ae6a-4d4fb13a62bb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:09.666735 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bbea4048-c325-4ee9-ae6a-4d4fb13a62bb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:09.667175 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bbea4048-c325-4ee9-ae6a-4d4fb13a62bb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:09.798554 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bbea4048-c325-4ee9-ae6a-4d4fb13a62bb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:09.807089 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bbea4048-c325-4ee9-ae6a-4d4fb13a62bb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:09.808639 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bbea4048-c325-4ee9-ae6a-4d4fb13a62bb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:09.809734 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-bbea4048-c325-4ee9-ae6a-4d4fb13a62bb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1408 microversion: 2.20 time: 0.155354 Nov 21 13:56:09.810294 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 304/626] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:56:09 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:56:10.668704 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-d1bf376c-eaa8-46f4-aa9e-ed2cdaa7129b req-0e9de45a-f304-42ae-a503-4955aeb6bc81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e70a1a57-c34e-418a-b973-e938389a3fa2", "name": "network-vif-plugged", "status": "completed", "tag": "73851145-2483-4c28-bf3b-f049e97c28cc"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:10.670410 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:56:10.670410 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:56:10.678392 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-d1bf376c-eaa8-46f4-aa9e-ed2cdaa7129b req-0e9de45a-f304-42ae-a503-4955aeb6bc81 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:10.678946 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-d1bf376c-eaa8-46f4-aa9e-ed2cdaa7129b req-0e9de45a-f304-42ae-a503-4955aeb6bc81 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:10.691360 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-d1bf376c-eaa8-46f4-aa9e-ed2cdaa7129b req-0e9de45a-f304-42ae-a503-4955aeb6bc81 service nova] Creating event network-vif-plugged:73851145-2483-4c28-bf3b-f049e97c28cc for instance e70a1a57-c34e-418a-b973-e938389a3fa2 on hv-cinder-76845 Nov 21 13:56:10.696316 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-d1bf376c-eaa8-46f4-aa9e-ed2cdaa7129b req-0e9de45a-f304-42ae-a503-4955aeb6bc81 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031222 Nov 21 13:56:10.696911 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 323/627] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:56:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:56:10.827999 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-4d836e83-20d7-4674-9108-085b6d5560c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:10.828670 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-4d836e83-20d7-4674-9108-085b6d5560c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:10.834677 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4d836e83-20d7-4674-9108-085b6d5560c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:10.835134 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4d836e83-20d7-4674-9108-085b6d5560c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:10.836005 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4d836e83-20d7-4674-9108-085b6d5560c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:10.836443 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4d836e83-20d7-4674-9108-085b6d5560c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:11.001790 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4d836e83-20d7-4674-9108-085b6d5560c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:11.009749 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4d836e83-20d7-4674-9108-085b6d5560c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:11.011253 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4d836e83-20d7-4674-9108-085b6d5560c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:11.012395 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-4d836e83-20d7-4674-9108-085b6d5560c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1408 microversion: 2.20 time: 0.188120 Nov 21 13:56:11.012959 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 305/628] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:56:10 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:56:12.031248 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-0104156e-99f9-475a-8cac-f5ef6d5f8d8d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:12.031977 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-0104156e-99f9-475a-8cac-f5ef6d5f8d8d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:12.038230 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0104156e-99f9-475a-8cac-f5ef6d5f8d8d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:12.038686 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0104156e-99f9-475a-8cac-f5ef6d5f8d8d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:12.039471 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0104156e-99f9-475a-8cac-f5ef6d5f8d8d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:12.039965 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0104156e-99f9-475a-8cac-f5ef6d5f8d8d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:12.173274 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-0104156e-99f9-475a-8cac-f5ef6d5f8d8d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:12.181707 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-0104156e-99f9-475a-8cac-f5ef6d5f8d8d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:12.183205 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-0104156e-99f9-475a-8cac-f5ef6d5f8d8d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:12.184331 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-0104156e-99f9-475a-8cac-f5ef6d5f8d8d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1408 microversion: 2.20 time: 0.157635 Nov 21 13:56:12.184885 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 324/629] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:56:12 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:56:13.201726 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-2e3757bc-4345-4645-af21-8712ee17470f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:13.202364 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-2e3757bc-4345-4645-af21-8712ee17470f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:13.209478 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2e3757bc-4345-4645-af21-8712ee17470f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:13.210219 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2e3757bc-4345-4645-af21-8712ee17470f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:13.211018 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2e3757bc-4345-4645-af21-8712ee17470f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:13.211458 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2e3757bc-4345-4645-af21-8712ee17470f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:13.354354 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-e00eb719-3c25-4d60-a743-c7dcde02860d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:13.355546 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-e00eb719-3c25-4d60-a743-c7dcde02860d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:13.362660 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e00eb719-3c25-4d60-a743-c7dcde02860d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:13.363301 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e00eb719-3c25-4d60-a743-c7dcde02860d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:13.364765 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e00eb719-3c25-4d60-a743-c7dcde02860d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:13.365405 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e00eb719-3c25-4d60-a743-c7dcde02860d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:13.369266 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2e3757bc-4345-4645-af21-8712ee17470f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:13.381509 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2e3757bc-4345-4645-af21-8712ee17470f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:13.381509 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2e3757bc-4345-4645-af21-8712ee17470f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:13.382515 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-2e3757bc-4345-4645-af21-8712ee17470f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1600 microversion: 2.20 time: 0.184524 Nov 21 13:56:13.383417 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 306/630] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:56:13 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1600 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:56:13.399924 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-8c7444c3-905e-4b33-9456-530b950985ee tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:13.400516 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-8c7444c3-905e-4b33-9456-530b950985ee tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:13.406869 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8c7444c3-905e-4b33-9456-530b950985ee tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:13.407636 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8c7444c3-905e-4b33-9456-530b950985ee tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:13.408706 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8c7444c3-905e-4b33-9456-530b950985ee tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:13.409384 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8c7444c3-905e-4b33-9456-530b950985ee tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:13.426470 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-e00eb719-3c25-4d60-a743-c7dcde02860d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075778 Nov 21 13:56:13.427040 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 325/631] 10.222.0.11 () {58 vars in 1301 bytes} [Sun Nov 21 13:56:13 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 21 13:56:13.485005 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-979191c9-7b3c-4b19-8729-11570beb51fd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:13.485833 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-979191c9-7b3c-4b19-8729-11570beb51fd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:13.492503 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-979191c9-7b3c-4b19-8729-11570beb51fd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:13.492951 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-979191c9-7b3c-4b19-8729-11570beb51fd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:13.494247 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-979191c9-7b3c-4b19-8729-11570beb51fd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:13.494683 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-979191c9-7b3c-4b19-8729-11570beb51fd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:13.497595 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-8c7444c3-905e-4b33-9456-530b950985ee tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101726 Nov 21 13:56:13.498182 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 307/632] 10.222.0.11 () {60 vars in 1315 bytes} [Sun Nov 21 13:56:13 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 13:56:13.524361 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-979191c9-7b3c-4b19-8729-11570beb51fd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Going to try to terminate instance {{(pid=122564) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 21 13:56:13.604539 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-979191c9-7b3c-4b19-8729-11570beb51fd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "DELETE /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 204 len: 0 microversion: 2.1 time: 0.122926 Nov 21 13:56:13.609166 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 326/633] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 13:56:13 2021] DELETE /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 21 13:56:13.618478 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-57721c23-633f-4839-965e-eb5b6b8bb1e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:13.619416 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-57721c23-633f-4839-965e-eb5b6b8bb1e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:13.626532 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-57721c23-633f-4839-965e-eb5b6b8bb1e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:13.627743 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-57721c23-633f-4839-965e-eb5b6b8bb1e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:13.628718 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-57721c23-633f-4839-965e-eb5b6b8bb1e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:13.629659 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-57721c23-633f-4839-965e-eb5b6b8bb1e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:13.776647 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-57721c23-633f-4839-965e-eb5b6b8bb1e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:13.785326 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-57721c23-633f-4839-965e-eb5b6b8bb1e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1673 microversion: 2.1 time: 0.174267 Nov 21 13:56:13.787859 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 308/634] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:13 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:14.673675 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-8dc22033-243b-48cf-800f-89c34a142f95 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:14.679320 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-4113c229-0f39-4f30-bcc1-87eb292f41ba req-a8dfa5f0-02c5-4ff1-a110-31fe53284f6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e70a1a57-c34e-418a-b973-e938389a3fa2", "tag": "73851145-2483-4c28-bf3b-f049e97c28cc"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:14.681406 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:56:14.681406 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:56:14.686427 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-8dc22033-243b-48cf-800f-89c34a142f95 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:14.697157 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-4113c229-0f39-4f30-bcc1-87eb292f41ba req-a8dfa5f0-02c5-4ff1-a110-31fe53284f6b service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:14.698142 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8dc22033-243b-48cf-800f-89c34a142f95 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:14.698875 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-4113c229-0f39-4f30-bcc1-87eb292f41ba req-a8dfa5f0-02c5-4ff1-a110-31fe53284f6b service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:14.699486 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8dc22033-243b-48cf-800f-89c34a142f95 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:14.704575 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8dc22033-243b-48cf-800f-89c34a142f95 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:14.706209 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8dc22033-243b-48cf-800f-89c34a142f95 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:14.717807 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-4113c229-0f39-4f30-bcc1-87eb292f41ba req-a8dfa5f0-02c5-4ff1-a110-31fe53284f6b service nova] Creating event network-changed:73851145-2483-4c28-bf3b-f049e97c28cc for instance e70a1a57-c34e-418a-b973-e938389a3fa2 on hv-cinder-76845 Nov 21 13:56:14.732862 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-4113c229-0f39-4f30-bcc1-87eb292f41ba req-a8dfa5f0-02c5-4ff1-a110-31fe53284f6b service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056973 Nov 21 13:56:14.744110 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 309/635] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:56:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:56:14.792191 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-8dc22033-243b-48cf-800f-89c34a142f95 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 14 microversion: 2.20 time: 0.121887 Nov 21 13:56:14.796705 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 327/636] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:14 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:14.804488 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-e7fb63c3-4871-48c1-913c-a58ec953d826 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:14.805208 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-e7fb63c3-4871-48c1-913c-a58ec953d826 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:14.811835 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e7fb63c3-4871-48c1-913c-a58ec953d826 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:14.812002 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e7fb63c3-4871-48c1-913c-a58ec953d826 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:14.812732 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e7fb63c3-4871-48c1-913c-a58ec953d826 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:14.813162 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e7fb63c3-4871-48c1-913c-a58ec953d826 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:15.084898 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-e7fb63c3-4871-48c1-913c-a58ec953d826 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:15.107658 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-e7fb63c3-4871-48c1-913c-a58ec953d826 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1673 microversion: 2.1 time: 0.296251 Nov 21 13:56:15.108984 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 310/637] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:14 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1673 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:15.802868 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-5dc7c225-186f-4187-b626-b8da63a6b0d4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:15.803880 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-5dc7c225-186f-4187-b626-b8da63a6b0d4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:15.811407 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5dc7c225-186f-4187-b626-b8da63a6b0d4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:15.811886 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5dc7c225-186f-4187-b626-b8da63a6b0d4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:15.812895 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5dc7c225-186f-4187-b626-b8da63a6b0d4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:15.813500 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5dc7c225-186f-4187-b626-b8da63a6b0d4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:15.887202 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-5dc7c225-186f-4187-b626-b8da63a6b0d4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 14 microversion: 2.20 time: 0.087778 Nov 21 13:56:15.888478 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 328/638] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:15 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:16.124716 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-9b88fb87-de5f-4909-97c3-3606b0be9979 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:16.125703 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-9b88fb87-de5f-4909-97c3-3606b0be9979 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:16.132688 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9b88fb87-de5f-4909-97c3-3606b0be9979 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:16.133242 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9b88fb87-de5f-4909-97c3-3606b0be9979 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:16.134102 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9b88fb87-de5f-4909-97c3-3606b0be9979 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:16.134611 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9b88fb87-de5f-4909-97c3-3606b0be9979 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:16.477475 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-9b88fb87-de5f-4909-97c3-3606b0be9979 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:16.484692 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-9b88fb87-de5f-4909-97c3-3606b0be9979 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1673 microversion: 2.1 time: 0.363648 Nov 21 13:56:16.485252 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 311/639] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:16 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1673 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:16.899466 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-919d1be2-1bbd-46e6-aaad-2570ac4b391c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:16.901487 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-919d1be2-1bbd-46e6-aaad-2570ac4b391c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:16.909956 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-919d1be2-1bbd-46e6-aaad-2570ac4b391c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:16.911067 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-919d1be2-1bbd-46e6-aaad-2570ac4b391c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:16.912096 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-919d1be2-1bbd-46e6-aaad-2570ac4b391c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:16.913092 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-919d1be2-1bbd-46e6-aaad-2570ac4b391c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:16.982466 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-919d1be2-1bbd-46e6-aaad-2570ac4b391c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 14 microversion: 2.20 time: 0.086755 Nov 21 13:56:16.987217 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 329/640] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:16 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:17.009493 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-4012397e-677f-41f9-ae78-9b90083c0e3b req-2db83ac0-6e26-45e0-b40e-2981e2f8e078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa7ec26-0d3e-4d40-87d2-45e63ed435eb", "name": "network-vif-deleted", "tag": "e97fd0d3-216a-4615-aa4a-a98857cba123"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:17.011395 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:56:17.011395 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:56:17.018842 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-4012397e-677f-41f9-ae78-9b90083c0e3b req-2db83ac0-6e26-45e0-b40e-2981e2f8e078 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:17.019517 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-4012397e-677f-41f9-ae78-9b90083c0e3b req-2db83ac0-6e26-45e0-b40e-2981e2f8e078 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:17.042949 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-4012397e-677f-41f9-ae78-9b90083c0e3b req-2db83ac0-6e26-45e0-b40e-2981e2f8e078 service nova] Creating event network-vif-deleted:e97fd0d3-216a-4615-aa4a-a98857cba123 for instance 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb on hv-cinder-76845 Nov 21 13:56:17.052255 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-4012397e-677f-41f9-ae78-9b90083c0e3b req-2db83ac0-6e26-45e0-b40e-2981e2f8e078 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046126 Nov 21 13:56:17.057966 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 312/641] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:56:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:56:17.507341 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-0fc64e6d-b75c-4f9f-9497-d0728a4b454c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:17.508223 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-0fc64e6d-b75c-4f9f-9497-d0728a4b454c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:17.515066 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0fc64e6d-b75c-4f9f-9497-d0728a4b454c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:17.515533 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0fc64e6d-b75c-4f9f-9497-d0728a4b454c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:17.516374 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0fc64e6d-b75c-4f9f-9497-d0728a4b454c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:17.516813 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0fc64e6d-b75c-4f9f-9497-d0728a4b454c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:17.553599 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0fc64e6d-b75c-4f9f-9497-d0728a4b454c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:17.554053 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0fc64e6d-b75c-4f9f-9497-d0728a4b454c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:17.554560 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.objects.instance [None req-0fc64e6d-b75c-4f9f-9497-d0728a4b454c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lazy-loading 'fault' on Instance uuid 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb {{(pid=122564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:56:17.601848 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-0fc64e6d-b75c-4f9f-9497-d0728a4b454c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:17.612651 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-0fc64e6d-b75c-4f9f-9497-d0728a4b454c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 200 len: 1327 microversion: 2.1 time: 0.109281 Nov 21 13:56:17.613497 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 330/642] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:17 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:17.993755 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-f22b1d85-e8a0-4c74-8451-e586bad7864e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:17.994758 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-f22b1d85-e8a0-4c74-8451-e586bad7864e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:18.001377 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f22b1d85-e8a0-4c74-8451-e586bad7864e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:18.001831 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f22b1d85-e8a0-4c74-8451-e586bad7864e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:18.002632 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f22b1d85-e8a0-4c74-8451-e586bad7864e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:18.003069 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f22b1d85-e8a0-4c74-8451-e586bad7864e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:18.070584 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-f22b1d85-e8a0-4c74-8451-e586bad7864e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 14 microversion: 2.20 time: 0.081154 Nov 21 13:56:18.074236 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 313/643] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:17 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:18.340039 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1465405613", "imageRef": "acdb574e-2ba9-4029-849b-377b4d5722ce", "flavorRef": "452", "networks": [{"uuid": "79b4766e-abe9-40ee-bfd9-f2f24b2ae559"}]}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:18.389592 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.network.neutron [None req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] validate_networks() for [('79b4766e-abe9-40ee-bfd9-f2f24b2ae559', None, None, None, None, None)] {{(pid=122564) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 21 13:56:18.630991 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-7db80dc3-bab3-4f46-b925-5447b2139109 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:18.631688 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-7db80dc3-bab3-4f46-b925-5447b2139109 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:18.638577 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7db80dc3-bab3-4f46-b925-5447b2139109 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:18.639031 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7db80dc3-bab3-4f46-b925-5447b2139109 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:18.639833 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7db80dc3-bab3-4f46-b925-5447b2139109 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:18.640271 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7db80dc3-bab3-4f46-b925-5447b2139109 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:18.653665 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-7db80dc3-bab3-4f46-b925-5447b2139109 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] HTTP exception thrown: Instance 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb could not be found. Nov 21 13:56:18.654251 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-7db80dc3-bab3-4f46-b925-5447b2139109 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Returning 404 to user: Instance 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:56:18.655063 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-7db80dc3-bab3-4f46-b925-5447b2139109 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 404 len: 111 microversion: 2.1 time: 0.028759 Nov 21 13:56:18.655591 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 314/644] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:18 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 21 13:56:18.663208 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-10234274-4bfb-4a2f-8f38-fa893aae24e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '.version_select at 0x7fd5134c0310>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:18.681002 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-10234274-4bfb-4a2f-8f38-fa893aae24e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306439029" status: 202 len: 0 microversion: 2.1 time: 0.021052 Nov 21 13:56:18.681616 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 315/645] 10.222.0.11 () {58 vars in 1220 bytes} [Sun Nov 21 13:56:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306439029 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:56:18.718449 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Flavor limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 13:56:18.718898 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Image limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 13:56:18.719370 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Flavor pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 13:56:18.719773 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Image pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 13:56:18.720199 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 13:56:18.728568 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:18.729011 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:18.729820 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:18.730267 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:18.747054 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Getting quotas for project 017390dd50484d0bb3cf04f97f3cfdb9. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:56:18.751120 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Getting quotas for user b27b5cb18eb046a09196a7f26e4fde3a and project 017390dd50484d0bb3cf04f97f3cfdb9. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:56:18.762356 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Going to run 1 instances... {{(pid=122564) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 13:56:18.764726 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: 27eea7fb-f06b-42eb-9503-ea9712ab787d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='acdb574e-2ba9-4029-849b-377b4d5722ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 13:56:18.807136 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.470630 Nov 21 13:56:18.807932 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 331/646] 10.222.0.11 () {60 vars in 1146 bytes} [Sun Nov 21 13:56:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 13:56:18.820706 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-aa5e9b3b-a1ca-4425-917b-50c23fccff20 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:18.821328 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-aa5e9b3b-a1ca-4425-917b-50c23fccff20 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: 27eea7fb-f06b-42eb-9503-ea9712ab787d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:18.891798 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-aa5e9b3b-a1ca-4425-917b-50c23fccff20 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:18.898350 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-aa5e9b3b-a1ca-4425-917b-50c23fccff20 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d" status: 200 len: 1214 microversion: 2.1 time: 0.084346 Nov 21 13:56:18.899155 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 316/647] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:18 2021] GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:19.082783 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ede76875-5634-449e-bbcd-d2805d02f2a5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:19.083783 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ede76875-5634-449e-bbcd-d2805d02f2a5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:19.091009 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ede76875-5634-449e-bbcd-d2805d02f2a5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:19.091467 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ede76875-5634-449e-bbcd-d2805d02f2a5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:19.092292 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ede76875-5634-449e-bbcd-d2805d02f2a5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:19.092954 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ede76875-5634-449e-bbcd-d2805d02f2a5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:19.162347 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ede76875-5634-449e-bbcd-d2805d02f2a5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 14 microversion: 2.20 time: 0.083726 Nov 21 13:56:19.162990 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 332/648] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:19 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:19.384184 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-bf8b5253-f6a0-4f81-af79-c1289231d35f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'create', calling method: .version_select at 0x7fd5135e11f0>, body: {"keypair": {"name": "tempest-keypair-1263095797"}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:19.399201 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-bf8b5253-f6a0-4f81-af79-c1289231d35f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Getting quotas for project 389c281a19bb49e583633f57108f7f69. Resources: {'key_pairs'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:56:19.402942 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-bf8b5253-f6a0-4f81-af79-c1289231d35f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Getting quotas for user 07abcb2febc44ec8a0a2493b53233a66 and project 389c281a19bb49e583633f57108f7f69. Resources: {'key_pairs'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:56:19.557515 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-bf8b5253-f6a0-4f81-af79-c1289231d35f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Getting quotas for project 389c281a19bb49e583633f57108f7f69. Resources: {'key_pairs'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:56:19.561012 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-bf8b5253-f6a0-4f81-af79-c1289231d35f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Getting quotas for user 07abcb2febc44ec8a0a2493b53233a66 and project 389c281a19bb49e583633f57108f7f69. Resources: {'key_pairs'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:56:19.573528 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-bf8b5253-f6a0-4f81-af79-c1289231d35f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.193291 Nov 21 13:56:19.574125 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 317/649] 10.222.0.11 () {60 vars in 1157 bytes} [Sun Nov 21 13:56:19 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:19.914860 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2ff79599-793b-4833-9d73-5cd8a4716889 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:19.916364 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-2ff79599-793b-4833-9d73-5cd8a4716889 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: 27eea7fb-f06b-42eb-9503-ea9712ab787d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:19.924144 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2ff79599-793b-4833-9d73-5cd8a4716889 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:19.924949 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2ff79599-793b-4833-9d73-5cd8a4716889 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:19.925994 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2ff79599-793b-4833-9d73-5cd8a4716889 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:19.926648 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2ff79599-793b-4833-9d73-5cd8a4716889 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:20.014948 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-2ff79599-793b-4833-9d73-5cd8a4716889 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:20.026750 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-2ff79599-793b-4833-9d73-5cd8a4716889 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d" status: 200 len: 1284 microversion: 2.1 time: 0.115641 Nov 21 13:56:20.027329 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 333/650] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:19 2021] GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d => generated 1284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:20.172687 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-067c2870-9a78-4ab2-b5f3-5243a43fe451 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:20.174348 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-067c2870-9a78-4ab2-b5f3-5243a43fe451 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:20.185256 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-067c2870-9a78-4ab2-b5f3-5243a43fe451 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:20.185808 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-067c2870-9a78-4ab2-b5f3-5243a43fe451 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:20.187236 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-067c2870-9a78-4ab2-b5f3-5243a43fe451 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:20.187690 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-067c2870-9a78-4ab2-b5f3-5243a43fe451 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:20.253917 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-067c2870-9a78-4ab2-b5f3-5243a43fe451 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 14 microversion: 2.20 time: 0.084823 Nov 21 13:56:20.257228 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 318/651] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:20 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:20.928239 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-08403e66-a92e-466b-a00f-473d0be394e5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2135509796", "imageRef": "acdb574e-2ba9-4029-849b-377b4d5722ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea19090b-8034-4904-8b6c-1752befe0b5a"}], "security_groups": [{"name": "tempest-securitygroup--1107963018"}], "key_name": "tempest-keypair-1263095797", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:21.032528 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.network.neutron [None req-08403e66-a92e-466b-a00f-473d0be394e5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] validate_networks() for [('ea19090b-8034-4904-8b6c-1752befe0b5a', None, None, None, None, None)] {{(pid=122564) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 21 13:56:21.043750 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-e115e3d3-6035-4bcb-ad2d-304ca3c76729 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:21.044476 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-e115e3d3-6035-4bcb-ad2d-304ca3c76729 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: 27eea7fb-f06b-42eb-9503-ea9712ab787d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:21.058794 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e115e3d3-6035-4bcb-ad2d-304ca3c76729 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:21.060456 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e115e3d3-6035-4bcb-ad2d-304ca3c76729 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:21.061332 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e115e3d3-6035-4bcb-ad2d-304ca3c76729 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:21.061774 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e115e3d3-6035-4bcb-ad2d-304ca3c76729 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:21.321527 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-e115e3d3-6035-4bcb-ad2d-304ca3c76729 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:21.328998 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-e115e3d3-6035-4bcb-ad2d-304ca3c76729 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d" status: 200 len: 1314 microversion: 2.1 time: 0.289018 Nov 21 13:56:21.329935 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 319/652] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:21 2021] GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:56:21.337493 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-2942fbad-a010-438f-9065-bf569470876c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:21.338911 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-2942fbad-a010-438f-9065-bf569470876c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:21.344926 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2942fbad-a010-438f-9065-bf569470876c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:21.345380 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2942fbad-a010-438f-9065-bf569470876c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:21.346673 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2942fbad-a010-438f-9065-bf569470876c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:21.347249 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2942fbad-a010-438f-9065-bf569470876c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:21.415293 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-2942fbad-a010-438f-9065-bf569470876c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 14 microversion: 2.20 time: 0.083905 Nov 21 13:56:21.418708 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 320/653] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:21 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:21.445067 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-08403e66-a92e-466b-a00f-473d0be394e5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Flavor limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 13:56:21.445498 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-08403e66-a92e-466b-a00f-473d0be394e5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Image limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 13:56:21.445952 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-08403e66-a92e-466b-a00f-473d0be394e5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Flavor pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 13:56:21.446521 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-08403e66-a92e-466b-a00f-473d0be394e5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Image pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 13:56:21.447305 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-08403e66-a92e-466b-a00f-473d0be394e5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 13:56:21.457299 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-08403e66-a92e-466b-a00f-473d0be394e5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:21.457729 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-08403e66-a92e-466b-a00f-473d0be394e5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:21.458548 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-08403e66-a92e-466b-a00f-473d0be394e5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:21.458986 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-08403e66-a92e-466b-a00f-473d0be394e5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:21.476405 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-08403e66-a92e-466b-a00f-473d0be394e5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Getting quotas for project 389c281a19bb49e583633f57108f7f69. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:56:21.480455 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-08403e66-a92e-466b-a00f-473d0be394e5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Getting quotas for user 07abcb2febc44ec8a0a2493b53233a66 and project 389c281a19bb49e583633f57108f7f69. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:56:21.492530 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-08403e66-a92e-466b-a00f-473d0be394e5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Going to run 1 instances... {{(pid=122564) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 13:56:21.495198 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-08403e66-a92e-466b-a00f-473d0be394e5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='acdb574e-2ba9-4029-849b-377b4d5722ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 13:56:21.503792 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-45220a7b-d707-45c3-9908-467395f51241 req-6ae363b6-7fb8-44c4-b90b-88a803e3d14e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27eea7fb-f06b-42eb-9503-ea9712ab787d", "tag": "4c2e5ca6-3438-48b9-9122-4ec3b5782d9f"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:21.505599 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:56:21.505599 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:56:21.516136 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-45220a7b-d707-45c3-9908-467395f51241 req-6ae363b6-7fb8-44c4-b90b-88a803e3d14e service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:21.526708 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-45220a7b-d707-45c3-9908-467395f51241 req-6ae363b6-7fb8-44c4-b90b-88a803e3d14e service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:21.539489 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-45220a7b-d707-45c3-9908-467395f51241 req-6ae363b6-7fb8-44c4-b90b-88a803e3d14e service nova] Creating event network-changed:4c2e5ca6-3438-48b9-9122-4ec3b5782d9f for instance 27eea7fb-f06b-42eb-9503-ea9712ab787d on hv-cinder-76845 Nov 21 13:56:21.544274 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-45220a7b-d707-45c3-9908-467395f51241 req-6ae363b6-7fb8-44c4-b90b-88a803e3d14e service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046578 Nov 21 13:56:21.545220 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 321/654] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:56:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:56:21.551030 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-08403e66-a92e-466b-a00f-473d0be394e5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.627246 Nov 21 13:56:21.551670 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 334/655] 10.222.0.11 () {60 vars in 1146 bytes} [Sun Nov 21 13:56:20 2021] POST /compute/v2.1/servers => generated 402 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 13:56:21.562898 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ff4d54ad-8f68-425b-9b12-a3f52e3d5752 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:21.563606 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ff4d54ad-8f68-425b-9b12-a3f52e3d5752 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:21.626123 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ff4d54ad-8f68-425b-9b12-a3f52e3d5752 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:21.634014 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ff4d54ad-8f68-425b-9b12-a3f52e3d5752 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156" status: 200 len: 1238 microversion: 2.1 time: 0.075777 Nov 21 13:56:21.634573 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 322/656] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:21 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156 => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:22.118584 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-bdec68e8-fbdd-483b-b80f-e38c11132e30 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:22.119758 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-bdec68e8-fbdd-483b-b80f-e38c11132e30 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:22.126861 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bdec68e8-fbdd-483b-b80f-e38c11132e30 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:22.127360 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bdec68e8-fbdd-483b-b80f-e38c11132e30 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:22.128183 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bdec68e8-fbdd-483b-b80f-e38c11132e30 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:22.128750 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bdec68e8-fbdd-483b-b80f-e38c11132e30 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:22.200460 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-bdec68e8-fbdd-483b-b80f-e38c11132e30 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "POST /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/action" status: 202 len: 0 microversion: 2.1 time: 0.086365 Nov 21 13:56:22.201097 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 335/657] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:22 2021] POST /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:56:22.209002 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-eb7f3bda-8e3b-4946-be7c-6b7cf581287d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:22.209620 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-eb7f3bda-8e3b-4946-be7c-6b7cf581287d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:22.216225 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-eb7f3bda-8e3b-4946-be7c-6b7cf581287d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:22.216921 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-eb7f3bda-8e3b-4946-be7c-6b7cf581287d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:22.217906 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-eb7f3bda-8e3b-4946-be7c-6b7cf581287d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:22.218346 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-eb7f3bda-8e3b-4946-be7c-6b7cf581287d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:22.346876 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-508d5401-45fb-4e75-b96e-217d71939957 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:22.347702 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-508d5401-45fb-4e75-b96e-217d71939957 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: 27eea7fb-f06b-42eb-9503-ea9712ab787d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:22.353790 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-508d5401-45fb-4e75-b96e-217d71939957 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:22.354308 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-508d5401-45fb-4e75-b96e-217d71939957 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:22.355096 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-508d5401-45fb-4e75-b96e-217d71939957 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:22.355527 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-508d5401-45fb-4e75-b96e-217d71939957 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:22.499174 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-508d5401-45fb-4e75-b96e-217d71939957 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:22.507410 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-508d5401-45fb-4e75-b96e-217d71939957 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d" status: 200 len: 1314 microversion: 2.1 time: 0.165169 Nov 21 13:56:22.508232 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 336/658] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:22 2021] GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:56:22.513097 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-eff84bef-53ee-48ca-a9f3-75bc3b7a342e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:22.514139 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-eff84bef-53ee-48ca-a9f3-75bc3b7a342e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:22.522585 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-eff84bef-53ee-48ca-a9f3-75bc3b7a342e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:22.523193 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-eff84bef-53ee-48ca-a9f3-75bc3b7a342e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:22.524257 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-eff84bef-53ee-48ca-a9f3-75bc3b7a342e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:22.524821 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-eff84bef-53ee-48ca-a9f3-75bc3b7a342e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:22.590635 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-eff84bef-53ee-48ca-a9f3-75bc3b7a342e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 14 microversion: 2.20 time: 0.080647 Nov 21 13:56:22.591210 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 337/659] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:22 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:22.652041 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-c954f1c8-6f74-4321-ab6b-c51d2f2fd346 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:22.652861 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-c954f1c8-6f74-4321-ab6b-c51d2f2fd346 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:22.661381 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c954f1c8-6f74-4321-ab6b-c51d2f2fd346 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:22.662247 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c954f1c8-6f74-4321-ab6b-c51d2f2fd346 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:22.663266 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c954f1c8-6f74-4321-ab6b-c51d2f2fd346 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:22.663776 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c954f1c8-6f74-4321-ab6b-c51d2f2fd346 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:22.679229 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-eb7f3bda-8e3b-4946-be7c-6b7cf581287d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:22.692864 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-eb7f3bda-8e3b-4946-be7c-6b7cf581287d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1749 microversion: 2.1 time: 0.486519 Nov 21 13:56:22.694463 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 323/660] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:22 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1749 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:22.730062 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-c954f1c8-6f74-4321-ab6b-c51d2f2fd346 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:22.737508 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-c954f1c8-6f74-4321-ab6b-c51d2f2fd346 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156" status: 200 len: 1296 microversion: 2.1 time: 0.090443 Nov 21 13:56:22.738074 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 338/661] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:22 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156 => generated 1296 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:56:23.526137 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-f4e2dc5a-f087-4c34-958b-0a97e30d29cd tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:23.526756 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-f4e2dc5a-f087-4c34-958b-0a97e30d29cd tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: 27eea7fb-f06b-42eb-9503-ea9712ab787d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:23.533550 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f4e2dc5a-f087-4c34-958b-0a97e30d29cd tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:23.534001 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f4e2dc5a-f087-4c34-958b-0a97e30d29cd tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:23.534818 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f4e2dc5a-f087-4c34-958b-0a97e30d29cd tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:23.535295 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f4e2dc5a-f087-4c34-958b-0a97e30d29cd tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:23.602948 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-3dff0004-9d20-44dc-8166-1077f5cb143e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:23.604738 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3dff0004-9d20-44dc-8166-1077f5cb143e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:23.611823 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3dff0004-9d20-44dc-8166-1077f5cb143e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:23.612569 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3dff0004-9d20-44dc-8166-1077f5cb143e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:23.613515 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3dff0004-9d20-44dc-8166-1077f5cb143e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:23.614183 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3dff0004-9d20-44dc-8166-1077f5cb143e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:23.689396 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-3dff0004-9d20-44dc-8166-1077f5cb143e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 14 microversion: 2.20 time: 0.086582 Nov 21 13:56:23.692362 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 339/662] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:23 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:23.712771 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-5087acd1-e87c-428a-90d4-36481b108d1a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:23.713770 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-5087acd1-e87c-428a-90d4-36481b108d1a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:23.721628 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5087acd1-e87c-428a-90d4-36481b108d1a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:23.722392 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5087acd1-e87c-428a-90d4-36481b108d1a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:23.723370 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5087acd1-e87c-428a-90d4-36481b108d1a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:23.724022 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5087acd1-e87c-428a-90d4-36481b108d1a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:23.782778 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-f4e2dc5a-f087-4c34-958b-0a97e30d29cd tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:23.795555 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-f4e2dc5a-f087-4c34-958b-0a97e30d29cd tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d" status: 200 len: 1314 microversion: 2.1 time: 0.274521 Nov 21 13:56:23.796187 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 324/663] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:23 2021] GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:23.815871 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-87820a66-b180-4f99-8586-a16e6170018d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:23.816371 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-87820a66-b180-4f99-8586-a16e6170018d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:23.826257 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-87820a66-b180-4f99-8586-a16e6170018d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:23.826907 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-87820a66-b180-4f99-8586-a16e6170018d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:23.827901 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-87820a66-b180-4f99-8586-a16e6170018d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:23.828506 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-87820a66-b180-4f99-8586-a16e6170018d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:23.895198 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-5087acd1-e87c-428a-90d4-36481b108d1a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:23.903366 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-5087acd1-e87c-428a-90d4-36481b108d1a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1754 microversion: 2.1 time: 0.194593 Nov 21 13:56:23.903977 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 340/664] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:23 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1754 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:56:24.084220 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-87820a66-b180-4f99-8586-a16e6170018d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:24.091907 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-87820a66-b180-4f99-8586-a16e6170018d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156" status: 200 len: 1364 microversion: 2.1 time: 0.280828 Nov 21 13:56:24.092488 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 325/665] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:23 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156 => generated 1364 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:24.418051 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-95c9aede-40b2-478c-8961-473344bfb56f req-26ec76ab-1e19-422a-bc30-32eb37f15fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7c81c3-cb32-476d-97c8-9a0d8d19f156", "tag": "8f627980-8d41-4f62-bfa8-683b4cdc0b4c"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:24.419630 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:56:24.419630 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:56:24.429461 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-95c9aede-40b2-478c-8961-473344bfb56f req-26ec76ab-1e19-422a-bc30-32eb37f15fa4 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:24.430177 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-95c9aede-40b2-478c-8961-473344bfb56f req-26ec76ab-1e19-422a-bc30-32eb37f15fa4 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:24.445889 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-95c9aede-40b2-478c-8961-473344bfb56f req-26ec76ab-1e19-422a-bc30-32eb37f15fa4 service nova] Creating event network-changed:8f627980-8d41-4f62-bfa8-683b4cdc0b4c for instance fe7c81c3-cb32-476d-97c8-9a0d8d19f156 on hv-cinder-76845 Nov 21 13:56:24.452030 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-95c9aede-40b2-478c-8961-473344bfb56f req-26ec76ab-1e19-422a-bc30-32eb37f15fa4 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037423 Nov 21 13:56:24.452698 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 341/666] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:56:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:56:24.700830 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-e517d0f7-c95e-4c51-b7be-367964366ed4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:24.702275 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-e517d0f7-c95e-4c51-b7be-367964366ed4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:24.709084 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e517d0f7-c95e-4c51-b7be-367964366ed4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:24.709538 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e517d0f7-c95e-4c51-b7be-367964366ed4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:24.710468 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e517d0f7-c95e-4c51-b7be-367964366ed4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:24.711072 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e517d0f7-c95e-4c51-b7be-367964366ed4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:24.788715 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-e517d0f7-c95e-4c51-b7be-367964366ed4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 14 microversion: 2.20 time: 0.092158 Nov 21 13:56:24.791873 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 326/667] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:24 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:24.813005 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-7df92e79-a2bb-4272-a607-755d273f49bd tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:24.814517 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-7df92e79-a2bb-4272-a607-755d273f49bd tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: 27eea7fb-f06b-42eb-9503-ea9712ab787d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:24.821848 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7df92e79-a2bb-4272-a607-755d273f49bd tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:24.823354 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7df92e79-a2bb-4272-a607-755d273f49bd tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:24.823497 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7df92e79-a2bb-4272-a607-755d273f49bd tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:24.823866 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7df92e79-a2bb-4272-a607-755d273f49bd tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:24.921755 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-2bc731ef-6d53-4365-ba3b-5423798939ae tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:24.922463 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-2bc731ef-6d53-4365-ba3b-5423798939ae tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:24.929826 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2bc731ef-6d53-4365-ba3b-5423798939ae tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:24.930449 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2bc731ef-6d53-4365-ba3b-5423798939ae tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:24.931247 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2bc731ef-6d53-4365-ba3b-5423798939ae tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:24.931682 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2bc731ef-6d53-4365-ba3b-5423798939ae tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:24.967569 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-7df92e79-a2bb-4272-a607-755d273f49bd tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:24.975480 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-7df92e79-a2bb-4272-a607-755d273f49bd tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d" status: 200 len: 1314 microversion: 2.1 time: 0.166692 Nov 21 13:56:24.976090 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 342/668] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:24 2021] GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:56:25.114880 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-18f1a29b-1cca-47e4-aa22-9aef65690ebc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:25.115768 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-18f1a29b-1cca-47e4-aa22-9aef65690ebc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:25.126172 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-18f1a29b-1cca-47e4-aa22-9aef65690ebc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:25.126630 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-18f1a29b-1cca-47e4-aa22-9aef65690ebc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:25.127963 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-18f1a29b-1cca-47e4-aa22-9aef65690ebc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:25.128705 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-18f1a29b-1cca-47e4-aa22-9aef65690ebc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:25.203748 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2bc731ef-6d53-4365-ba3b-5423798939ae tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:25.212257 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-2bc731ef-6d53-4365-ba3b-5423798939ae tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1754 microversion: 2.1 time: 0.294712 Nov 21 13:56:25.213168 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 327/669] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:24 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1754 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:56:25.264684 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-18f1a29b-1cca-47e4-aa22-9aef65690ebc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:25.272668 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-18f1a29b-1cca-47e4-aa22-9aef65690ebc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156" status: 200 len: 1364 microversion: 2.1 time: 0.166355 Nov 21 13:56:25.281777 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 343/670] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:25 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:25.799163 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-9ca5758f-e919-46fc-911e-5bbe4134ce80 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:25.800170 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-9ca5758f-e919-46fc-911e-5bbe4134ce80 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:25.807200 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9ca5758f-e919-46fc-911e-5bbe4134ce80 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:25.807655 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9ca5758f-e919-46fc-911e-5bbe4134ce80 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:25.808464 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9ca5758f-e919-46fc-911e-5bbe4134ce80 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:25.808904 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9ca5758f-e919-46fc-911e-5bbe4134ce80 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:25.868513 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-9ca5758f-e919-46fc-911e-5bbe4134ce80 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 14 microversion: 2.20 time: 0.072874 Nov 21 13:56:25.869129 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 328/671] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:25 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:25.992479 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-055d87e5-b331-44e3-934b-a8c40105d01c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:25.993084 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-055d87e5-b331-44e3-934b-a8c40105d01c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: 27eea7fb-f06b-42eb-9503-ea9712ab787d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:25.999261 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-055d87e5-b331-44e3-934b-a8c40105d01c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:25.999708 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-055d87e5-b331-44e3-934b-a8c40105d01c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:26.000764 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-055d87e5-b331-44e3-934b-a8c40105d01c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:26.001193 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-055d87e5-b331-44e3-934b-a8c40105d01c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:26.132085 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-055d87e5-b331-44e3-934b-a8c40105d01c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:26.143938 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-055d87e5-b331-44e3-934b-a8c40105d01c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d" status: 200 len: 1314 microversion: 2.1 time: 0.155014 Nov 21 13:56:26.144519 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 344/672] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:25 2021] GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:26.229669 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c96614e8-d06b-41dd-bd13-00734e852dd3 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:26.230374 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-c96614e8-d06b-41dd-bd13-00734e852dd3 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:26.237854 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c96614e8-d06b-41dd-bd13-00734e852dd3 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:26.238302 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c96614e8-d06b-41dd-bd13-00734e852dd3 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:26.239084 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c96614e8-d06b-41dd-bd13-00734e852dd3 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:26.239521 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c96614e8-d06b-41dd-bd13-00734e852dd3 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:26.289176 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-401300fe-5033-4f6e-bfed-c2edb9904233 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:26.289939 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-401300fe-5033-4f6e-bfed-c2edb9904233 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:26.295707 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-401300fe-5033-4f6e-bfed-c2edb9904233 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:26.296200 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-401300fe-5033-4f6e-bfed-c2edb9904233 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:26.296990 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-401300fe-5033-4f6e-bfed-c2edb9904233 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:26.297434 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-401300fe-5033-4f6e-bfed-c2edb9904233 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:26.386636 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-c96614e8-d06b-41dd-bd13-00734e852dd3 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:26.394510 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c96614e8-d06b-41dd-bd13-00734e852dd3 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1754 microversion: 2.1 time: 0.168965 Nov 21 13:56:26.395083 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 329/673] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:26 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:26.427096 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-401300fe-5033-4f6e-bfed-c2edb9904233 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:26.434359 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-401300fe-5033-4f6e-bfed-c2edb9904233 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156" status: 200 len: 1364 microversion: 2.1 time: 0.148889 Nov 21 13:56:26.434915 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 345/674] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:26 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:56:26.774773 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-a7620bb8-a7f3-4849-9e2b-3df48db4e0fb req-b39d8cd7-68e3-492a-bdc8-6d1db5f9a399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27eea7fb-f06b-42eb-9503-ea9712ab787d", "name": "network-vif-plugged", "status": "completed", "tag": "4c2e5ca6-3438-48b9-9122-4ec3b5782d9f"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:26.776647 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:56:26.776647 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:56:26.787689 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-a7620bb8-a7f3-4849-9e2b-3df48db4e0fb req-b39d8cd7-68e3-492a-bdc8-6d1db5f9a399 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:26.788164 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-a7620bb8-a7f3-4849-9e2b-3df48db4e0fb req-b39d8cd7-68e3-492a-bdc8-6d1db5f9a399 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:26.800448 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-a7620bb8-a7f3-4849-9e2b-3df48db4e0fb req-b39d8cd7-68e3-492a-bdc8-6d1db5f9a399 service nova] Creating event network-vif-plugged:4c2e5ca6-3438-48b9-9122-4ec3b5782d9f for instance 27eea7fb-f06b-42eb-9503-ea9712ab787d on hv-cinder-76845 Nov 21 13:56:26.805435 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-a7620bb8-a7f3-4849-9e2b-3df48db4e0fb req-b39d8cd7-68e3-492a-bdc8-6d1db5f9a399 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036404 Nov 21 13:56:26.806412 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 330/675] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:56:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:56:26.879341 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-5e6d8439-9728-40ad-b45c-a5b03cc3719b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:26.880855 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-5e6d8439-9728-40ad-b45c-a5b03cc3719b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:26.886610 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5e6d8439-9728-40ad-b45c-a5b03cc3719b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:26.887057 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5e6d8439-9728-40ad-b45c-a5b03cc3719b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:26.887885 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5e6d8439-9728-40ad-b45c-a5b03cc3719b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:26.888315 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5e6d8439-9728-40ad-b45c-a5b03cc3719b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:26.977082 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-5e6d8439-9728-40ad-b45c-a5b03cc3719b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 9752 microversion: 2.20 time: 0.101068 Nov 21 13:56:26.980410 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 346/676] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:26 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 9752 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:56:27.162942 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-cb6d5168-c513-42f5-9151-0d9a0b94e22f tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:27.163654 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-cb6d5168-c513-42f5-9151-0d9a0b94e22f tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: 27eea7fb-f06b-42eb-9503-ea9712ab787d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:27.170100 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cb6d5168-c513-42f5-9151-0d9a0b94e22f tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:27.170544 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cb6d5168-c513-42f5-9151-0d9a0b94e22f tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:27.171312 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cb6d5168-c513-42f5-9151-0d9a0b94e22f tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:27.171743 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cb6d5168-c513-42f5-9151-0d9a0b94e22f tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:27.304002 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-cb6d5168-c513-42f5-9151-0d9a0b94e22f tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:27.311168 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-cb6d5168-c513-42f5-9151-0d9a0b94e22f tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d" status: 200 len: 1314 microversion: 2.1 time: 0.152210 Nov 21 13:56:27.311734 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 331/677] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:27 2021] GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:27.412189 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-08bfd0c4-2715-4db6-9422-2ecb9d5c252f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:27.412903 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-08bfd0c4-2715-4db6-9422-2ecb9d5c252f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:27.419718 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-08bfd0c4-2715-4db6-9422-2ecb9d5c252f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:27.420209 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-08bfd0c4-2715-4db6-9422-2ecb9d5c252f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:27.420989 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-08bfd0c4-2715-4db6-9422-2ecb9d5c252f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:27.421431 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-08bfd0c4-2715-4db6-9422-2ecb9d5c252f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:27.450039 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-e35144c5-f0bb-40ce-b143-ffd19665ea88 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:27.450651 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-e35144c5-f0bb-40ce-b143-ffd19665ea88 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:27.457115 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e35144c5-f0bb-40ce-b143-ffd19665ea88 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:27.457568 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e35144c5-f0bb-40ce-b143-ffd19665ea88 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:27.458347 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e35144c5-f0bb-40ce-b143-ffd19665ea88 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:27.458783 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e35144c5-f0bb-40ce-b143-ffd19665ea88 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:27.574985 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-08bfd0c4-2715-4db6-9422-2ecb9d5c252f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:27.582701 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-08bfd0c4-2715-4db6-9422-2ecb9d5c252f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1754 microversion: 2.1 time: 0.174550 Nov 21 13:56:27.583267 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 347/678] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:27 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:27.591479 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-e35144c5-f0bb-40ce-b143-ffd19665ea88 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:27.598743 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-e35144c5-f0bb-40ce-b143-ffd19665ea88 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156" status: 200 len: 1364 microversion: 2.1 time: 0.152282 Nov 21 13:56:27.599295 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 332/679] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:27 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:56:27.988324 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-cbf61280-417f-4270-a683-8ba2aebcc541 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:27.989291 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-cbf61280-417f-4270-a683-8ba2aebcc541 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:27.995504 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cbf61280-417f-4270-a683-8ba2aebcc541 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:27.995999 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cbf61280-417f-4270-a683-8ba2aebcc541 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:27.996772 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cbf61280-417f-4270-a683-8ba2aebcc541 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:27.997205 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-cbf61280-417f-4270-a683-8ba2aebcc541 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:28.084050 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-cbf61280-417f-4270-a683-8ba2aebcc541 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 15145 microversion: 2.20 time: 0.099856 Nov 21 13:56:28.084938 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 348/680] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:27 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 15145 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:56:28.328516 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-9d09d295-637e-44a2-ba9d-734c2c05c963 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:28.329137 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-9d09d295-637e-44a2-ba9d-734c2c05c963 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: 27eea7fb-f06b-42eb-9503-ea9712ab787d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:28.336086 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9d09d295-637e-44a2-ba9d-734c2c05c963 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:28.336547 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9d09d295-637e-44a2-ba9d-734c2c05c963 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:28.337336 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9d09d295-637e-44a2-ba9d-734c2c05c963 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:28.337776 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9d09d295-637e-44a2-ba9d-734c2c05c963 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:28.470268 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-9d09d295-637e-44a2-ba9d-734c2c05c963 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:28.478150 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-9d09d295-637e-44a2-ba9d-734c2c05c963 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d" status: 200 len: 1498 microversion: 2.1 time: 0.153419 Nov 21 13:56:28.478710 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 333/681] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:28 2021] GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:28.599358 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-167907ed-501d-439d-98d3-0e681845ec4c tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:28.600079 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-167907ed-501d-439d-98d3-0e681845ec4c tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:28.606708 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-167907ed-501d-439d-98d3-0e681845ec4c tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:28.607155 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-167907ed-501d-439d-98d3-0e681845ec4c tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:28.608076 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-167907ed-501d-439d-98d3-0e681845ec4c tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:28.608513 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-167907ed-501d-439d-98d3-0e681845ec4c tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:28.616872 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-5f7a4dce-c387-4230-8374-c83ee5c1e99c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:28.617749 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-5f7a4dce-c387-4230-8374-c83ee5c1e99c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:28.623892 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5f7a4dce-c387-4230-8374-c83ee5c1e99c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:28.624355 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5f7a4dce-c387-4230-8374-c83ee5c1e99c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:28.625463 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5f7a4dce-c387-4230-8374-c83ee5c1e99c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:28.627364 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5f7a4dce-c387-4230-8374-c83ee5c1e99c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:28.780083 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-167907ed-501d-439d-98d3-0e681845ec4c tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:28.790386 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-167907ed-501d-439d-98d3-0e681845ec4c tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1754 microversion: 2.1 time: 0.195011 Nov 21 13:56:28.791166 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 349/682] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:28 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1754 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:28.926977 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-77fa8725-a4d9-4f85-86f6-b08e33b10e64 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:28.927438 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-77fa8725-a4d9-4f85-86f6-b08e33b10e64 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: 27eea7fb-f06b-42eb-9503-ea9712ab787d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:28.933794 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-77fa8725-a4d9-4f85-86f6-b08e33b10e64 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:28.934244 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-77fa8725-a4d9-4f85-86f6-b08e33b10e64 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:28.935028 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-77fa8725-a4d9-4f85-86f6-b08e33b10e64 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:28.935461 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-77fa8725-a4d9-4f85-86f6-b08e33b10e64 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:28.961950 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-77fa8725-a4d9-4f85-86f6-b08e33b10e64 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: 27eea7fb-f06b-42eb-9503-ea9712ab787d] Going to try to terminate instance {{(pid=122564) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 21 13:56:29.039906 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-77fa8725-a4d9-4f85-86f6-b08e33b10e64 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "DELETE /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d" status: 204 len: 0 microversion: 2.1 time: 0.115633 Nov 21 13:56:29.040511 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 350/683] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 13:56:28 2021] DELETE /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 21 13:56:29.049496 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-e62ab3ce-5c6f-41d5-b994-7ce9930a9d8d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:29.050225 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-e62ab3ce-5c6f-41d5-b994-7ce9930a9d8d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: 27eea7fb-f06b-42eb-9503-ea9712ab787d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:29.053729 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-5f7a4dce-c387-4230-8374-c83ee5c1e99c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:29.059258 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e62ab3ce-5c6f-41d5-b994-7ce9930a9d8d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:29.059707 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e62ab3ce-5c6f-41d5-b994-7ce9930a9d8d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:29.060553 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e62ab3ce-5c6f-41d5-b994-7ce9930a9d8d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:29.060981 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e62ab3ce-5c6f-41d5-b994-7ce9930a9d8d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:29.061180 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-5f7a4dce-c387-4230-8374-c83ee5c1e99c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156" status: 200 len: 1364 microversion: 2.1 time: 0.449734 Nov 21 13:56:29.062053 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 334/684] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:28 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156 => generated 1364 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:56:29.094438 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-1e7f8157-b455-4a9c-aa01-36cc97c1047d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:29.095412 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-1e7f8157-b455-4a9c-aa01-36cc97c1047d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:29.101255 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1e7f8157-b455-4a9c-aa01-36cc97c1047d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:29.101701 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1e7f8157-b455-4a9c-aa01-36cc97c1047d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:29.102476 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1e7f8157-b455-4a9c-aa01-36cc97c1047d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:29.102907 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1e7f8157-b455-4a9c-aa01-36cc97c1047d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:29.184742 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-1e7f8157-b455-4a9c-aa01-36cc97c1047d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 18083 microversion: 2.20 time: 0.093819 Nov 21 13:56:29.185855 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 335/685] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:29 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 18083 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:56:29.201046 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-e62ab3ce-5c6f-41d5-b994-7ce9930a9d8d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:29.208687 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-e62ab3ce-5c6f-41d5-b994-7ce9930a9d8d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d" status: 200 len: 1504 microversion: 2.1 time: 0.163891 Nov 21 13:56:29.209258 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 351/686] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:29 2021] GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:29.808873 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a96ae4c4-2bd7-4e76-a64d-a57744e5cfdb tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:29.809570 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a96ae4c4-2bd7-4e76-a64d-a57744e5cfdb tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:29.816459 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a96ae4c4-2bd7-4e76-a64d-a57744e5cfdb tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:29.816911 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a96ae4c4-2bd7-4e76-a64d-a57744e5cfdb tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:29.817688 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a96ae4c4-2bd7-4e76-a64d-a57744e5cfdb tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:29.818126 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a96ae4c4-2bd7-4e76-a64d-a57744e5cfdb tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:29.956893 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a96ae4c4-2bd7-4e76-a64d-a57744e5cfdb tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:29.964539 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a96ae4c4-2bd7-4e76-a64d-a57744e5cfdb tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1754 microversion: 2.1 time: 0.159701 Nov 21 13:56:29.965106 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 336/687] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:29 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:30.078559 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-3142db7d-b236-44c1-bc2e-aa12fb77469a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:30.079153 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3142db7d-b236-44c1-bc2e-aa12fb77469a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:30.086005 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3142db7d-b236-44c1-bc2e-aa12fb77469a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:30.086457 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3142db7d-b236-44c1-bc2e-aa12fb77469a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:30.087233 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3142db7d-b236-44c1-bc2e-aa12fb77469a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:30.087697 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3142db7d-b236-44c1-bc2e-aa12fb77469a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:30.196532 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-54e5c3b9-097a-447c-9cc2-92e80779a0e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:30.197499 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-54e5c3b9-097a-447c-9cc2-92e80779a0e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:30.203699 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-54e5c3b9-097a-447c-9cc2-92e80779a0e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:30.204651 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-54e5c3b9-097a-447c-9cc2-92e80779a0e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:30.206085 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-54e5c3b9-097a-447c-9cc2-92e80779a0e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:30.206518 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-54e5c3b9-097a-447c-9cc2-92e80779a0e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:30.218436 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-3142db7d-b236-44c1-bc2e-aa12fb77469a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:30.225856 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-3142db7d-b236-44c1-bc2e-aa12fb77469a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156" status: 200 len: 1364 microversion: 2.1 time: 0.150971 Nov 21 13:56:30.226526 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 352/688] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:30 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:30.231500 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-71c465ed-ac74-4967-8972-db4f65463b72 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:30.232406 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-71c465ed-ac74-4967-8972-db4f65463b72 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: 27eea7fb-f06b-42eb-9503-ea9712ab787d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:30.238533 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-71c465ed-ac74-4967-8972-db4f65463b72 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:30.238975 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-71c465ed-ac74-4967-8972-db4f65463b72 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:30.239745 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-71c465ed-ac74-4967-8972-db4f65463b72 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:30.240206 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-71c465ed-ac74-4967-8972-db4f65463b72 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:30.282761 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-54e5c3b9-097a-447c-9cc2-92e80779a0e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 19342 microversion: 2.20 time: 0.089733 Nov 21 13:56:30.283465 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 337/689] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:30 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 19342 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:56:30.372035 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-71c465ed-ac74-4967-8972-db4f65463b72 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:30.380004 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-71c465ed-ac74-4967-8972-db4f65463b72 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d" status: 200 len: 1504 microversion: 2.1 time: 0.151806 Nov 21 13:56:30.380564 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 353/690] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:30 2021] GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:30.807074 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-705b6271-91ea-445e-9b4f-1b356110e1b2 req-56584025-85b3-4df7-a34c-bb341a846927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7c81c3-cb32-476d-97c8-9a0d8d19f156", "name": "network-vif-plugged", "status": "completed", "tag": "8f627980-8d41-4f62-bfa8-683b4cdc0b4c"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:30.808655 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:56:30.808655 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:56:30.817106 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-705b6271-91ea-445e-9b4f-1b356110e1b2 req-56584025-85b3-4df7-a34c-bb341a846927 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:30.817698 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-705b6271-91ea-445e-9b4f-1b356110e1b2 req-56584025-85b3-4df7-a34c-bb341a846927 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:30.829092 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-705b6271-91ea-445e-9b4f-1b356110e1b2 req-56584025-85b3-4df7-a34c-bb341a846927 service nova] Creating event network-vif-plugged:8f627980-8d41-4f62-bfa8-683b4cdc0b4c for instance fe7c81c3-cb32-476d-97c8-9a0d8d19f156 on hv-cinder-76845 Nov 21 13:56:30.833781 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-705b6271-91ea-445e-9b4f-1b356110e1b2 req-56584025-85b3-4df7-a34c-bb341a846927 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030872 Nov 21 13:56:30.834533 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 338/691] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:56:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:56:30.982171 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-562b8c5e-9c25-4a70-8897-ebaeb02bbc34 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:30.982697 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-562b8c5e-9c25-4a70-8897-ebaeb02bbc34 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:30.989264 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-562b8c5e-9c25-4a70-8897-ebaeb02bbc34 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:30.989807 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-562b8c5e-9c25-4a70-8897-ebaeb02bbc34 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:30.990598 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-562b8c5e-9c25-4a70-8897-ebaeb02bbc34 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:30.991037 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-562b8c5e-9c25-4a70-8897-ebaeb02bbc34 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:31.146865 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-562b8c5e-9c25-4a70-8897-ebaeb02bbc34 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:31.155702 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-562b8c5e-9c25-4a70-8897-ebaeb02bbc34 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1754 microversion: 2.1 time: 0.177137 Nov 21 13:56:31.156325 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 354/692] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:30 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:56:31.159298 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-07c8701b-e1da-424b-8273-2bfb576422ef req-c5a7d6b8-d91d-4386-b7bd-98390d1938ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27eea7fb-f06b-42eb-9503-ea9712ab787d", "name": "network-vif-deleted", "tag": "4c2e5ca6-3438-48b9-9122-4ec3b5782d9f"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:31.160833 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:56:31.160833 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:56:31.169013 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-07c8701b-e1da-424b-8273-2bfb576422ef req-c5a7d6b8-d91d-4386-b7bd-98390d1938ae service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:31.169480 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-07c8701b-e1da-424b-8273-2bfb576422ef req-c5a7d6b8-d91d-4386-b7bd-98390d1938ae service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:31.180499 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-07c8701b-e1da-424b-8273-2bfb576422ef req-c5a7d6b8-d91d-4386-b7bd-98390d1938ae service nova] Creating event network-vif-deleted:4c2e5ca6-3438-48b9-9122-4ec3b5782d9f for instance 27eea7fb-f06b-42eb-9503-ea9712ab787d on hv-cinder-76845 Nov 21 13:56:31.185058 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-07c8701b-e1da-424b-8273-2bfb576422ef req-c5a7d6b8-d91d-4386-b7bd-98390d1938ae service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031189 Nov 21 13:56:31.185619 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 339/693] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:56:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:56:31.242726 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-205296ca-6d30-49b3-9011-f5760cb78c34 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:31.243296 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-205296ca-6d30-49b3-9011-f5760cb78c34 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:31.249083 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-205296ca-6d30-49b3-9011-f5760cb78c34 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:31.249527 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-205296ca-6d30-49b3-9011-f5760cb78c34 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:31.250558 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-205296ca-6d30-49b3-9011-f5760cb78c34 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:31.250985 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-205296ca-6d30-49b3-9011-f5760cb78c34 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:31.294720 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c8d61a8d-2e83-49f3-9a15-63cc0e2b00c4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:31.295723 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-c8d61a8d-2e83-49f3-9a15-63cc0e2b00c4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:31.302719 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c8d61a8d-2e83-49f3-9a15-63cc0e2b00c4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:31.303202 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c8d61a8d-2e83-49f3-9a15-63cc0e2b00c4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:31.304013 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c8d61a8d-2e83-49f3-9a15-63cc0e2b00c4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:31.304480 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c8d61a8d-2e83-49f3-9a15-63cc0e2b00c4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:31.383342 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-205296ca-6d30-49b3-9011-f5760cb78c34 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:31.390526 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-205296ca-6d30-49b3-9011-f5760cb78c34 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156" status: 200 len: 1364 microversion: 2.1 time: 0.151524 Nov 21 13:56:31.391266 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 355/694] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:31 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:31.397430 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-dcbbb419-eec1-41e0-8897-30aeade2bbde tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:31.398040 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-dcbbb419-eec1-41e0-8897-30aeade2bbde tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: 27eea7fb-f06b-42eb-9503-ea9712ab787d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:31.404267 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-dcbbb419-eec1-41e0-8897-30aeade2bbde tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:31.404737 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-dcbbb419-eec1-41e0-8897-30aeade2bbde tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:31.405516 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-dcbbb419-eec1-41e0-8897-30aeade2bbde tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:31.405953 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-dcbbb419-eec1-41e0-8897-30aeade2bbde tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:31.423518 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c8d61a8d-2e83-49f3-9a15-63cc0e2b00c4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 21972 microversion: 2.20 time: 0.132428 Nov 21 13:56:31.424310 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 340/695] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:31 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 21972 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:56:31.466957 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-dcbbb419-eec1-41e0-8897-30aeade2bbde tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:31.475933 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-dcbbb419-eec1-41e0-8897-30aeade2bbde tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d" status: 200 len: 1299 microversion: 2.1 time: 0.081394 Nov 21 13:56:31.477708 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 356/696] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:31 2021] GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d => generated 1299 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:56:32.174536 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-49e6a73c-a596-48a9-b353-d85fe0ace4e3 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:32.175228 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-49e6a73c-a596-48a9-b353-d85fe0ace4e3 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:32.182107 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-49e6a73c-a596-48a9-b353-d85fe0ace4e3 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:32.182558 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-49e6a73c-a596-48a9-b353-d85fe0ace4e3 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:32.183331 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-49e6a73c-a596-48a9-b353-d85fe0ace4e3 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:32.183762 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-49e6a73c-a596-48a9-b353-d85fe0ace4e3 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:32.338415 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-49e6a73c-a596-48a9-b353-d85fe0ace4e3 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:32.346255 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-49e6a73c-a596-48a9-b353-d85fe0ace4e3 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1754 microversion: 2.1 time: 0.176212 Nov 21 13:56:32.346822 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 341/697] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:32 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:32.407390 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-fb1ac4bc-f0f2-4361-9831-b114b0f06cd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:32.408554 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-fb1ac4bc-f0f2-4361-9831-b114b0f06cd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:32.414691 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fb1ac4bc-f0f2-4361-9831-b114b0f06cd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:32.415121 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fb1ac4bc-f0f2-4361-9831-b114b0f06cd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:32.415922 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fb1ac4bc-f0f2-4361-9831-b114b0f06cd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:32.416357 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fb1ac4bc-f0f2-4361-9831-b114b0f06cd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:32.435124 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-460a9ca7-d1b5-4d59-9706-d574056260ce tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:32.436026 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-460a9ca7-d1b5-4d59-9706-d574056260ce tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:32.441718 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-460a9ca7-d1b5-4d59-9706-d574056260ce tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:32.442172 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-460a9ca7-d1b5-4d59-9706-d574056260ce tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:32.443010 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-460a9ca7-d1b5-4d59-9706-d574056260ce tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:32.443453 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-460a9ca7-d1b5-4d59-9706-d574056260ce tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:32.516359 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-460a9ca7-d1b5-4d59-9706-d574056260ce tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 23234 microversion: 2.20 time: 0.084749 Nov 21 13:56:32.519310 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 342/698] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:32 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 23234 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:56:32.521999 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-eee8584d-e1ea-4862-93a1-420aa5d8d0ab tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:32.522824 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-eee8584d-e1ea-4862-93a1-420aa5d8d0ab tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: 27eea7fb-f06b-42eb-9503-ea9712ab787d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:32.530242 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-eee8584d-e1ea-4862-93a1-420aa5d8d0ab tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:32.530697 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-eee8584d-e1ea-4862-93a1-420aa5d8d0ab tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:32.531477 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-eee8584d-e1ea-4862-93a1-420aa5d8d0ab tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:32.531940 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-eee8584d-e1ea-4862-93a1-420aa5d8d0ab tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:32.546019 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-eee8584d-e1ea-4862-93a1-420aa5d8d0ab tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] HTTP exception thrown: Instance 27eea7fb-f06b-42eb-9503-ea9712ab787d could not be found. Nov 21 13:56:32.546622 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-eee8584d-e1ea-4862-93a1-420aa5d8d0ab tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Returning 404 to user: Instance 27eea7fb-f06b-42eb-9503-ea9712ab787d could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:56:32.547583 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-eee8584d-e1ea-4862-93a1-420aa5d8d0ab tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d" status: 404 len: 111 microversion: 2.1 time: 0.029515 Nov 21 13:56:32.548188 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 343/699] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:32 2021] GET /compute/v2.1/servers/27eea7fb-f06b-42eb-9503-ea9712ab787d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:56:32.552009 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-fb1ac4bc-f0f2-4361-9831-b114b0f06cd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:32.559765 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-fb1ac4bc-f0f2-4361-9831-b114b0f06cd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156" status: 200 len: 1550 microversion: 2.1 time: 0.155971 Nov 21 13:56:32.568169 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 357/700] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:32 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156 => generated 1550 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:32.576845 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-bafba58d-7ba8-4643-bf05-84a09d52d802 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:32.577410 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-bafba58d-7ba8-4643-bf05-84a09d52d802 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:32.583435 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bafba58d-7ba8-4643-bf05-84a09d52d802 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:32.583908 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bafba58d-7ba8-4643-bf05-84a09d52d802 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:32.584705 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bafba58d-7ba8-4643-bf05-84a09d52d802 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:32.585146 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bafba58d-7ba8-4643-bf05-84a09d52d802 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:32.598132 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-33e5425c-065c-4cb2-9aa0-f6fed91a944d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1152049984", "imageRef": "acdb574e-2ba9-4029-849b-377b4d5722ce", "flavorRef": "452", "networks": [{"uuid": "79b4766e-abe9-40ee-bfd9-f2f24b2ae559"}]}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:32.648257 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.network.neutron [None req-33e5425c-065c-4cb2-9aa0-f6fed91a944d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] validate_networks() for [('79b4766e-abe9-40ee-bfd9-f2f24b2ae559', None, None, None, None, None)] {{(pid=122564) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 21 13:56:32.670441 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-bafba58d-7ba8-4643-bf05-84a09d52d802 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098141 Nov 21 13:56:32.671121 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 344/701] 10.222.0.11 () {58 vars in 1274 bytes} [Sun Nov 21 13:56:32 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:56:32.993239 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-33e5425c-065c-4cb2-9aa0-f6fed91a944d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Flavor limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 13:56:32.993666 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-33e5425c-065c-4cb2-9aa0-f6fed91a944d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Image limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 13:56:32.994140 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-33e5425c-065c-4cb2-9aa0-f6fed91a944d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Flavor pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 13:56:32.994545 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-33e5425c-065c-4cb2-9aa0-f6fed91a944d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Image pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 13:56:32.994951 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-33e5425c-065c-4cb2-9aa0-f6fed91a944d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 13:56:33.003713 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-33e5425c-065c-4cb2-9aa0-f6fed91a944d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:33.004211 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-33e5425c-065c-4cb2-9aa0-f6fed91a944d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:33.005021 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-33e5425c-065c-4cb2-9aa0-f6fed91a944d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:33.005452 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-33e5425c-065c-4cb2-9aa0-f6fed91a944d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:33.022288 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-33e5425c-065c-4cb2-9aa0-f6fed91a944d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Getting quotas for project 017390dd50484d0bb3cf04f97f3cfdb9. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:56:33.026121 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-33e5425c-065c-4cb2-9aa0-f6fed91a944d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Getting quotas for user b27b5cb18eb046a09196a7f26e4fde3a and project 017390dd50484d0bb3cf04f97f3cfdb9. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:56:33.037172 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-33e5425c-065c-4cb2-9aa0-f6fed91a944d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Going to run 1 instances... {{(pid=122564) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 13:56:33.039476 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-33e5425c-065c-4cb2-9aa0-f6fed91a944d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: e9dc0276-9434-487d-a1ac-e95f0c499129] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='acdb574e-2ba9-4029-849b-377b4d5722ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 13:56:33.087468 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-33e5425c-065c-4cb2-9aa0-f6fed91a944d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.493461 Nov 21 13:56:33.093167 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 358/702] 10.222.0.11 () {60 vars in 1146 bytes} [Sun Nov 21 13:56:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 21 13:56:33.099234 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-63eac586-bebf-4116-9677-fbf9690fee38 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:33.099878 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-63eac586-bebf-4116-9677-fbf9690fee38 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: e9dc0276-9434-487d-a1ac-e95f0c499129] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:33.173707 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-63eac586-bebf-4116-9677-fbf9690fee38 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:33.180642 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-63eac586-bebf-4116-9677-fbf9690fee38 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129" status: 200 len: 1214 microversion: 2.1 time: 0.086153 Nov 21 13:56:33.181600 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 345/703] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:33 2021] GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:56:33.362858 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-e8840603-d024-4678-8352-6c0152af07ad tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:33.363619 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-e8840603-d024-4678-8352-6c0152af07ad tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:33.370483 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e8840603-d024-4678-8352-6c0152af07ad tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:33.371047 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e8840603-d024-4678-8352-6c0152af07ad tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:33.371996 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e8840603-d024-4678-8352-6c0152af07ad tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:33.372538 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e8840603-d024-4678-8352-6c0152af07ad tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:33.528354 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-e8840603-d024-4678-8352-6c0152af07ad tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:33.529006 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-2edd848d-88b2-4c86-9ffc-1b30b75c43b5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:33.529615 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-2edd848d-88b2-4c86-9ffc-1b30b75c43b5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:33.539439 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-e8840603-d024-4678-8352-6c0152af07ad tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1754 microversion: 2.1 time: 0.180575 Nov 21 13:56:33.540065 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2edd848d-88b2-4c86-9ffc-1b30b75c43b5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:33.549931 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 359/704] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:33 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1754 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:33.551101 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2edd848d-88b2-4c86-9ffc-1b30b75c43b5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:33.552347 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2edd848d-88b2-4c86-9ffc-1b30b75c43b5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:33.552851 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2edd848d-88b2-4c86-9ffc-1b30b75c43b5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:33.634072 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-2edd848d-88b2-4c86-9ffc-1b30b75c43b5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 24671 microversion: 2.20 time: 0.109591 Nov 21 13:56:33.635264 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 346/705] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:33 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 24671 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:56:33.695156 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-43bc9e1b-261d-4161-9b04-e99489ec8ef7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:33.697086 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-43bc9e1b-261d-4161-9b04-e99489ec8ef7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:33.697514 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-480dfac1-6263-478e-8bee-f3a74ff6ad70 req-fe401329-b1c3-4241-9cd1-08fa1a8e6238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7c81c3-cb32-476d-97c8-9a0d8d19f156", "tag": "8f627980-8d41-4f62-bfa8-683b4cdc0b4c"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:33.698964 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:56:33.698964 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:56:33.705854 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-43bc9e1b-261d-4161-9b04-e99489ec8ef7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:33.706527 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-43bc9e1b-261d-4161-9b04-e99489ec8ef7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:33.707483 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-43bc9e1b-261d-4161-9b04-e99489ec8ef7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:33.707608 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-480dfac1-6263-478e-8bee-f3a74ff6ad70 req-fe401329-b1c3-4241-9cd1-08fa1a8e6238 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:33.708166 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-480dfac1-6263-478e-8bee-f3a74ff6ad70 req-fe401329-b1c3-4241-9cd1-08fa1a8e6238 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:33.708613 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-43bc9e1b-261d-4161-9b04-e99489ec8ef7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:33.720111 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-480dfac1-6263-478e-8bee-f3a74ff6ad70 req-fe401329-b1c3-4241-9cd1-08fa1a8e6238 service nova] Creating event network-changed:8f627980-8d41-4f62-bfa8-683b4cdc0b4c for instance fe7c81c3-cb32-476d-97c8-9a0d8d19f156 on hv-cinder-76845 Nov 21 13:56:33.725396 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-480dfac1-6263-478e-8bee-f3a74ff6ad70 req-fe401329-b1c3-4241-9cd1-08fa1a8e6238 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031578 Nov 21 13:56:33.726592 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 347/706] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:56:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:56:33.794682 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-43bc9e1b-261d-4161-9b04-e99489ec8ef7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 14 microversion: 2.1 time: 0.104862 Nov 21 13:56:33.795322 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 360/707] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:33 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:56:34.198961 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-b3e8ae75-a587-49ae-a6ff-a4de0d90173e tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:34.199667 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-b3e8ae75-a587-49ae-a6ff-a4de0d90173e tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: e9dc0276-9434-487d-a1ac-e95f0c499129] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:34.206415 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b3e8ae75-a587-49ae-a6ff-a4de0d90173e tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:34.206866 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b3e8ae75-a587-49ae-a6ff-a4de0d90173e tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:34.207670 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b3e8ae75-a587-49ae-a6ff-a4de0d90173e tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:34.208481 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b3e8ae75-a587-49ae-a6ff-a4de0d90173e tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:34.291913 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-b3e8ae75-a587-49ae-a6ff-a4de0d90173e tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:34.301012 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-b3e8ae75-a587-49ae-a6ff-a4de0d90173e tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129" status: 200 len: 1274 microversion: 2.1 time: 0.106229 Nov 21 13:56:34.302895 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 348/708] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:34 2021] GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129 => generated 1274 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:34.558004 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-641c8b5f-4c78-4ef1-85fa-25e1785bb5b4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:34.559291 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-641c8b5f-4c78-4ef1-85fa-25e1785bb5b4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:34.567452 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-641c8b5f-4c78-4ef1-85fa-25e1785bb5b4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:34.567937 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-641c8b5f-4c78-4ef1-85fa-25e1785bb5b4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:34.568738 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-641c8b5f-4c78-4ef1-85fa-25e1785bb5b4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:34.569614 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-641c8b5f-4c78-4ef1-85fa-25e1785bb5b4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:34.646872 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ef0421f3-7467-4cdf-9d43-574cdacc3c8d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:34.648202 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ef0421f3-7467-4cdf-9d43-574cdacc3c8d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:34.655073 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ef0421f3-7467-4cdf-9d43-574cdacc3c8d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:34.655683 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ef0421f3-7467-4cdf-9d43-574cdacc3c8d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:34.656805 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ef0421f3-7467-4cdf-9d43-574cdacc3c8d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:34.657449 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ef0421f3-7467-4cdf-9d43-574cdacc3c8d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:34.738583 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-641c8b5f-4c78-4ef1-85fa-25e1785bb5b4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:34.741064 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ef0421f3-7467-4cdf-9d43-574cdacc3c8d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 25910 microversion: 2.20 time: 0.097946 Nov 21 13:56:34.741715 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 349/709] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:34 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 25910 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:56:34.747857 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-641c8b5f-4c78-4ef1-85fa-25e1785bb5b4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1754 microversion: 2.1 time: 0.193869 Nov 21 13:56:34.748435 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 361/710] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:34 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1754 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:34.808788 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a5b32565-33d3-4493-9b12-d4467ff9a1c8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:34.811237 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a5b32565-33d3-4493-9b12-d4467ff9a1c8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:34.818532 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a5b32565-33d3-4493-9b12-d4467ff9a1c8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:34.818984 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a5b32565-33d3-4493-9b12-d4467ff9a1c8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:34.819880 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a5b32565-33d3-4493-9b12-d4467ff9a1c8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:34.820320 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a5b32565-33d3-4493-9b12-d4467ff9a1c8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:34.890894 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a5b32565-33d3-4493-9b12-d4467ff9a1c8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 14 microversion: 2.1 time: 0.088557 Nov 21 13:56:34.891901 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 350/711] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:34 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:56:35.318130 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2dcb11f2-07ea-49f4-9d9a-6020d771dfec tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:35.318662 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-2dcb11f2-07ea-49f4-9d9a-6020d771dfec tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: e9dc0276-9434-487d-a1ac-e95f0c499129] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:35.324886 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2dcb11f2-07ea-49f4-9d9a-6020d771dfec tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:35.325350 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2dcb11f2-07ea-49f4-9d9a-6020d771dfec tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:35.326170 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2dcb11f2-07ea-49f4-9d9a-6020d771dfec tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:35.326613 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2dcb11f2-07ea-49f4-9d9a-6020d771dfec tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:35.461452 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-2dcb11f2-07ea-49f4-9d9a-6020d771dfec tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:35.468810 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-2dcb11f2-07ea-49f4-9d9a-6020d771dfec tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129" status: 200 len: 1314 microversion: 2.1 time: 0.154501 Nov 21 13:56:35.469376 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 362/712] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:35 2021] GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:35.741638 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-f53d914e-3008-4fb0-b293-46b55a33d85f req-95e874df-b697-4607-b131-52d572f9c241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9dc0276-9434-487d-a1ac-e95f0c499129", "tag": "a98bf10e-b29e-4c77-8249-7c04d7ab12b9"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:35.743245 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:56:35.743245 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:56:35.752377 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-f53d914e-3008-4fb0-b293-46b55a33d85f req-95e874df-b697-4607-b131-52d572f9c241 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:35.752908 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-f53d914e-3008-4fb0-b293-46b55a33d85f req-95e874df-b697-4607-b131-52d572f9c241 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:35.753564 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-c4402ebf-9161-43ba-9850-234d2e17139b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:35.754902 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-c4402ebf-9161-43ba-9850-234d2e17139b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:35.762479 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c4402ebf-9161-43ba-9850-234d2e17139b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:35.762934 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c4402ebf-9161-43ba-9850-234d2e17139b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:35.763959 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c4402ebf-9161-43ba-9850-234d2e17139b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:35.764860 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c4402ebf-9161-43ba-9850-234d2e17139b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:35.764987 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-f53d914e-3008-4fb0-b293-46b55a33d85f req-95e874df-b697-4607-b131-52d572f9c241 service nova] Creating event network-changed:a98bf10e-b29e-4c77-8249-7c04d7ab12b9 for instance e9dc0276-9434-487d-a1ac-e95f0c499129 on hv-cinder-76845 Nov 21 13:56:35.770209 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-f53d914e-3008-4fb0-b293-46b55a33d85f req-95e874df-b697-4607-b131-52d572f9c241 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032513 Nov 21 13:56:35.770809 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 351/713] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:56:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:56:35.775735 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c168974f-f2ba-4244-bb44-bff65ed3595a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:35.776460 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-c168974f-f2ba-4244-bb44-bff65ed3595a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:35.782394 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c168974f-f2ba-4244-bb44-bff65ed3595a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:35.782852 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c168974f-f2ba-4244-bb44-bff65ed3595a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:35.783645 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c168974f-f2ba-4244-bb44-bff65ed3595a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:35.784107 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c168974f-f2ba-4244-bb44-bff65ed3595a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:35.843868 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-c4402ebf-9161-43ba-9850-234d2e17139b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 27119 microversion: 2.20 time: 0.094604 Nov 21 13:56:35.844550 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 363/714] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:35 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 27119 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:56:35.902496 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-08661fda-079b-446f-95de-ea24f0397dd9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:35.903618 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-08661fda-079b-446f-95de-ea24f0397dd9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:35.910465 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-08661fda-079b-446f-95de-ea24f0397dd9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:35.910915 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-08661fda-079b-446f-95de-ea24f0397dd9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:35.911694 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-08661fda-079b-446f-95de-ea24f0397dd9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:35.912158 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-08661fda-079b-446f-95de-ea24f0397dd9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:35.974237 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-08661fda-079b-446f-95de-ea24f0397dd9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 14 microversion: 2.1 time: 0.075609 Nov 21 13:56:35.975022 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 364/715] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:35 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 21 13:56:36.050950 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-c168974f-f2ba-4244-bb44-bff65ed3595a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:36.058831 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c168974f-f2ba-4244-bb44-bff65ed3595a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1754 microversion: 2.1 time: 0.286765 Nov 21 13:56:36.059402 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 352/716] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:35 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1754 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:36.486934 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-993d0186-e2fe-4652-b4ce-9c17c7c5651b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:36.487572 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-993d0186-e2fe-4652-b4ce-9c17c7c5651b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: e9dc0276-9434-487d-a1ac-e95f0c499129] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:36.494807 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-993d0186-e2fe-4652-b4ce-9c17c7c5651b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:36.495259 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-993d0186-e2fe-4652-b4ce-9c17c7c5651b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:36.496087 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-993d0186-e2fe-4652-b4ce-9c17c7c5651b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:36.496527 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-993d0186-e2fe-4652-b4ce-9c17c7c5651b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:36.633877 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-993d0186-e2fe-4652-b4ce-9c17c7c5651b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:36.641228 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-993d0186-e2fe-4652-b4ce-9c17c7c5651b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129" status: 200 len: 1314 microversion: 2.1 time: 0.159361 Nov 21 13:56:36.641795 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 365/717] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:36 2021] GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:36.855767 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-020d9fff-02f5-4b7a-852d-fecbd4a0892a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:36.857004 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-020d9fff-02f5-4b7a-852d-fecbd4a0892a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:36.865738 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-020d9fff-02f5-4b7a-852d-fecbd4a0892a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:36.866781 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-020d9fff-02f5-4b7a-852d-fecbd4a0892a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:36.867579 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-020d9fff-02f5-4b7a-852d-fecbd4a0892a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:36.868059 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-020d9fff-02f5-4b7a-852d-fecbd4a0892a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:36.948048 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-020d9fff-02f5-4b7a-852d-fecbd4a0892a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 27638 microversion: 2.20 time: 0.095977 Nov 21 13:56:36.948931 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 353/718] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:36 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 27638 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:56:36.984072 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b563001a-c3cb-4839-8ec7-ed8d335358df tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:36.984999 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b563001a-c3cb-4839-8ec7-ed8d335358df tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:36.991351 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b563001a-c3cb-4839-8ec7-ed8d335358df tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:36.991822 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b563001a-c3cb-4839-8ec7-ed8d335358df tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:36.992603 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b563001a-c3cb-4839-8ec7-ed8d335358df tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:36.993041 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b563001a-c3cb-4839-8ec7-ed8d335358df tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:37.054311 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-b563001a-c3cb-4839-8ec7-ed8d335358df tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 14 microversion: 2.1 time: 0.073757 Nov 21 13:56:37.054896 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 366/719] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:36 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 21 13:56:37.077079 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-fe47462e-4fba-4194-9658-e95ff7b0982e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:37.077752 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-fe47462e-4fba-4194-9658-e95ff7b0982e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:37.085183 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fe47462e-4fba-4194-9658-e95ff7b0982e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:37.085635 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fe47462e-4fba-4194-9658-e95ff7b0982e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:37.086421 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fe47462e-4fba-4194-9658-e95ff7b0982e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:37.086868 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fe47462e-4fba-4194-9658-e95ff7b0982e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:37.228996 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-fe47462e-4fba-4194-9658-e95ff7b0982e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:37.236725 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-fe47462e-4fba-4194-9658-e95ff7b0982e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1754 microversion: 2.1 time: 0.163754 Nov 21 13:56:37.237291 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 354/720] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:37 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:37.556990 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-5499815d-d064-4343-a883-fb1599f10230 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:37.557616 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-5499815d-d064-4343-a883-fb1599f10230 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:37.565080 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5499815d-d064-4343-a883-fb1599f10230 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:37.565556 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5499815d-d064-4343-a883-fb1599f10230 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:37.566331 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5499815d-d064-4343-a883-fb1599f10230 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:37.566767 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5499815d-d064-4343-a883-fb1599f10230 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:37.590553 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.objects.instance [None req-5499815d-d064-4343-a883-fb1599f10230 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lazy-loading 'flavor' on Instance uuid 2707c966-28e3-43ba-9241-d5629ba92b06 {{(pid=122564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:56:37.658588 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-dc86a932-33df-43e0-9ec7-ff87e790340b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:37.659440 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-dc86a932-33df-43e0-9ec7-ff87e790340b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: e9dc0276-9434-487d-a1ac-e95f0c499129] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:37.659776 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-5499815d-d064-4343-a883-fb1599f10230 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "POST /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06/action" status: 202 len: 0 microversion: 2.1 time: 0.106706 Nov 21 13:56:37.660393 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 367/721] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:37 2021] POST /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:56:37.665535 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dc86a932-33df-43e0-9ec7-ff87e790340b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:37.665995 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dc86a932-33df-43e0-9ec7-ff87e790340b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:37.666782 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dc86a932-33df-43e0-9ec7-ff87e790340b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:37.667225 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dc86a932-33df-43e0-9ec7-ff87e790340b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:37.668644 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b9cde2a6-5b5b-44c7-bce4-eab1e428c9d0 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:37.669218 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b9cde2a6-5b5b-44c7-bce4-eab1e428c9d0 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:37.679924 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b9cde2a6-5b5b-44c7-bce4-eab1e428c9d0 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:37.680379 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b9cde2a6-5b5b-44c7-bce4-eab1e428c9d0 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:37.685176 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b9cde2a6-5b5b-44c7-bce4-eab1e428c9d0 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:37.685176 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b9cde2a6-5b5b-44c7-bce4-eab1e428c9d0 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:37.806454 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-dc86a932-33df-43e0-9ec7-ff87e790340b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:37.813736 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-dc86a932-33df-43e0-9ec7-ff87e790340b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129" status: 200 len: 1314 microversion: 2.1 time: 0.159241 Nov 21 13:56:37.814399 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 355/722] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:37 2021] GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:56:37.819334 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-b9cde2a6-5b5b-44c7-bce4-eab1e428c9d0 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:37.826779 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-b9cde2a6-5b5b-44c7-bce4-eab1e428c9d0 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1569 microversion: 2.1 time: 0.162030 Nov 21 13:56:37.827368 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 368/723] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:37 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:56:37.959922 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-e6189c1e-21b5-4f30-9ccf-d98576541d3d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:37.960885 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-e6189c1e-21b5-4f30-9ccf-d98576541d3d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:37.967092 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e6189c1e-21b5-4f30-9ccf-d98576541d3d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:37.967536 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e6189c1e-21b5-4f30-9ccf-d98576541d3d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:37.968342 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e6189c1e-21b5-4f30-9ccf-d98576541d3d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:37.968776 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e6189c1e-21b5-4f30-9ccf-d98576541d3d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:38.049958 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-e6189c1e-21b5-4f30-9ccf-d98576541d3d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 28069 microversion: 2.20 time: 0.093822 Nov 21 13:56:38.050588 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 356/724] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:37 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 28069 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:56:38.064574 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-98df77d0-0247-4014-9c75-387d417eb448 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:38.065436 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-98df77d0-0247-4014-9c75-387d417eb448 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:38.071704 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-98df77d0-0247-4014-9c75-387d417eb448 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:38.072300 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-98df77d0-0247-4014-9c75-387d417eb448 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:38.073065 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-98df77d0-0247-4014-9c75-387d417eb448 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:38.073498 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-98df77d0-0247-4014-9c75-387d417eb448 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:38.132002 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-98df77d0-0247-4014-9c75-387d417eb448 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 14 microversion: 2.1 time: 0.070871 Nov 21 13:56:38.133273 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 369/725] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:38 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:56:38.254795 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-1da43091-6c1c-4c8c-a78b-f62abba18cf6 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:38.255498 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-1da43091-6c1c-4c8c-a78b-f62abba18cf6 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:38.262403 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1da43091-6c1c-4c8c-a78b-f62abba18cf6 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:38.262859 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1da43091-6c1c-4c8c-a78b-f62abba18cf6 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:38.263637 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1da43091-6c1c-4c8c-a78b-f62abba18cf6 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:38.264107 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1da43091-6c1c-4c8c-a78b-f62abba18cf6 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:38.410331 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-1da43091-6c1c-4c8c-a78b-f62abba18cf6 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:38.418043 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-1da43091-6c1c-4c8c-a78b-f62abba18cf6 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1754 microversion: 2.1 time: 0.167285 Nov 21 13:56:38.418601 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 357/726] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:38 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:38.830870 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-8615495a-6ba9-4789-9d70-f43afa16ab29 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:38.831579 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-8615495a-6ba9-4789-9d70-f43afa16ab29 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: e9dc0276-9434-487d-a1ac-e95f0c499129] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:38.838353 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8615495a-6ba9-4789-9d70-f43afa16ab29 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:38.838808 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8615495a-6ba9-4789-9d70-f43afa16ab29 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:38.839594 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8615495a-6ba9-4789-9d70-f43afa16ab29 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:38.840053 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8615495a-6ba9-4789-9d70-f43afa16ab29 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:38.843570 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-15473978-b7bf-4590-a308-421b1d1b23f6 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:38.844221 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-15473978-b7bf-4590-a308-421b1d1b23f6 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:38.850816 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-15473978-b7bf-4590-a308-421b1d1b23f6 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:38.851270 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-15473978-b7bf-4590-a308-421b1d1b23f6 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:38.852085 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-15473978-b7bf-4590-a308-421b1d1b23f6 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:38.852540 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-15473978-b7bf-4590-a308-421b1d1b23f6 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:38.992833 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-8615495a-6ba9-4789-9d70-f43afa16ab29 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:38.998838 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-15473978-b7bf-4590-a308-421b1d1b23f6 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:39.000575 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-8615495a-6ba9-4789-9d70-f43afa16ab29 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129" status: 200 len: 1314 microversion: 2.1 time: 0.173732 Nov 21 13:56:39.001985 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 370/727] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:38 2021] GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:39.007504 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-15473978-b7bf-4590-a308-421b1d1b23f6 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1569 microversion: 2.1 time: 0.167531 Nov 21 13:56:39.008076 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 358/728] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:38 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:39.061389 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-732acd66-def4-4905-b1a6-0d09d640b5b2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:39.062337 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-732acd66-def4-4905-b1a6-0d09d640b5b2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:39.068943 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-732acd66-def4-4905-b1a6-0d09d640b5b2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:39.069519 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-732acd66-def4-4905-b1a6-0d09d640b5b2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:39.070175 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-732acd66-def4-4905-b1a6-0d09d640b5b2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:39.070608 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-732acd66-def4-4905-b1a6-0d09d640b5b2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:39.142502 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-6139d0c3-5d98-4563-8989-67ddf7348b8a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:39.143603 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-6139d0c3-5d98-4563-8989-67ddf7348b8a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:39.150252 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6139d0c3-5d98-4563-8989-67ddf7348b8a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:39.150700 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6139d0c3-5d98-4563-8989-67ddf7348b8a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:39.151481 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6139d0c3-5d98-4563-8989-67ddf7348b8a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:39.151950 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6139d0c3-5d98-4563-8989-67ddf7348b8a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:39.181999 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-732acd66-def4-4905-b1a6-0d09d640b5b2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 28186 microversion: 2.20 time: 0.124159 Nov 21 13:56:39.182647 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 371/729] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:39 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 28186 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:56:39.217620 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-6139d0c3-5d98-4563-8989-67ddf7348b8a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 14 microversion: 2.1 time: 0.078675 Nov 21 13:56:39.218251 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 359/730] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:39 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:56:39.434781 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-1de43844-c9f8-4ae9-8f61-0cc4df0edf39 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:39.435505 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-1de43844-c9f8-4ae9-8f61-0cc4df0edf39 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:39.442459 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1de43844-c9f8-4ae9-8f61-0cc4df0edf39 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:39.442905 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1de43844-c9f8-4ae9-8f61-0cc4df0edf39 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:39.443677 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1de43844-c9f8-4ae9-8f61-0cc4df0edf39 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:39.444134 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1de43844-c9f8-4ae9-8f61-0cc4df0edf39 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:39.586792 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-1de43844-c9f8-4ae9-8f61-0cc4df0edf39 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:39.594481 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-1de43844-c9f8-4ae9-8f61-0cc4df0edf39 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1757 microversion: 2.1 time: 0.163723 Nov 21 13:56:39.595038 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 372/731] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:39 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:40.018352 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-7f7f4c35-7b21-40e0-96ae-079facea8fcf tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:40.019045 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-7f7f4c35-7b21-40e0-96ae-079facea8fcf tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: e9dc0276-9434-487d-a1ac-e95f0c499129] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:40.023439 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-04b22ad2-e6d8-4364-9703-b86793311f06 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:40.024081 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-04b22ad2-e6d8-4364-9703-b86793311f06 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:40.025898 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7f7f4c35-7b21-40e0-96ae-079facea8fcf tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:40.026378 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7f7f4c35-7b21-40e0-96ae-079facea8fcf tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:40.027160 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7f7f4c35-7b21-40e0-96ae-079facea8fcf tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:40.027593 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7f7f4c35-7b21-40e0-96ae-079facea8fcf tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:40.030228 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-04b22ad2-e6d8-4364-9703-b86793311f06 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:40.030678 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-04b22ad2-e6d8-4364-9703-b86793311f06 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:40.031461 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-04b22ad2-e6d8-4364-9703-b86793311f06 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:40.031919 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-04b22ad2-e6d8-4364-9703-b86793311f06 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:40.162055 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-7f7f4c35-7b21-40e0-96ae-079facea8fcf tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:40.168096 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-04b22ad2-e6d8-4364-9703-b86793311f06 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:40.169475 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-7f7f4c35-7b21-40e0-96ae-079facea8fcf tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129" status: 200 len: 1314 microversion: 2.1 time: 0.155186 Nov 21 13:56:40.170047 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 360/732] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:40 2021] GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:40.176392 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-04b22ad2-e6d8-4364-9703-b86793311f06 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1569 microversion: 2.1 time: 0.156650 Nov 21 13:56:40.176945 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 373/733] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:40 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:56:40.193143 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-6c3848ab-d0ac-4e49-aba3-f721edb730e5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:40.194148 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-6c3848ab-d0ac-4e49-aba3-f721edb730e5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:40.199906 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6c3848ab-d0ac-4e49-aba3-f721edb730e5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:40.200354 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6c3848ab-d0ac-4e49-aba3-f721edb730e5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:40.201124 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6c3848ab-d0ac-4e49-aba3-f721edb730e5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:40.201556 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6c3848ab-d0ac-4e49-aba3-f721edb730e5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:40.229111 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-57a38a5b-1c02-452e-b0ab-e522e601ced7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:40.230067 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-57a38a5b-1c02-452e-b0ab-e522e601ced7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:40.236465 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-57a38a5b-1c02-452e-b0ab-e522e601ced7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:40.236917 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-57a38a5b-1c02-452e-b0ab-e522e601ced7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:40.237691 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-57a38a5b-1c02-452e-b0ab-e522e601ced7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:40.238117 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-57a38a5b-1c02-452e-b0ab-e522e601ced7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:40.281879 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-6c3848ab-d0ac-4e49-aba3-f721edb730e5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 28311 microversion: 2.20 time: 0.092057 Nov 21 13:56:40.282575 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 361/734] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:40 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 28311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:56:40.319561 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-57a38a5b-1c02-452e-b0ab-e522e601ced7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 14 microversion: 2.1 time: 0.094287 Nov 21 13:56:40.320356 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 374/735] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:40 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 21 13:56:40.870506 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-40061bf8-084e-4d7a-9700-324171254242 req-a15fb48a-d349-430b-99cb-ddb0c0ab3d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9dc0276-9434-487d-a1ac-e95f0c499129", "name": "network-vif-plugged", "status": "completed", "tag": "a98bf10e-b29e-4c77-8249-7c04d7ab12b9"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:40.872222 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:56:40.872222 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:56:40.880819 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-40061bf8-084e-4d7a-9700-324171254242 req-a15fb48a-d349-430b-99cb-ddb0c0ab3d1f service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:40.881263 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-40061bf8-084e-4d7a-9700-324171254242 req-a15fb48a-d349-430b-99cb-ddb0c0ab3d1f service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:40.893062 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-40061bf8-084e-4d7a-9700-324171254242 req-a15fb48a-d349-430b-99cb-ddb0c0ab3d1f service nova] Creating event network-vif-plugged:a98bf10e-b29e-4c77-8249-7c04d7ab12b9 for instance e9dc0276-9434-487d-a1ac-e95f0c499129 on hv-cinder-76845 Nov 21 13:56:40.897625 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-40061bf8-084e-4d7a-9700-324171254242 req-a15fb48a-d349-430b-99cb-ddb0c0ab3d1f service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031137 Nov 21 13:56:40.898199 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 362/736] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:56:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:56:41.186519 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ec011f5c-12b9-4743-9f0d-c0403ac578ee tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:41.187223 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ec011f5c-12b9-4743-9f0d-c0403ac578ee tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: e9dc0276-9434-487d-a1ac-e95f0c499129] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:41.193572 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-dec9de7d-967d-4cb8-bf5c-1651387285f1 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:41.194279 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-dec9de7d-967d-4cb8-bf5c-1651387285f1 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:41.194862 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ec011f5c-12b9-4743-9f0d-c0403ac578ee tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:41.195404 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ec011f5c-12b9-4743-9f0d-c0403ac578ee tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:41.196221 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ec011f5c-12b9-4743-9f0d-c0403ac578ee tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:41.196992 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ec011f5c-12b9-4743-9f0d-c0403ac578ee tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:41.200238 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dec9de7d-967d-4cb8-bf5c-1651387285f1 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:41.200694 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dec9de7d-967d-4cb8-bf5c-1651387285f1 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:41.201484 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dec9de7d-967d-4cb8-bf5c-1651387285f1 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:41.201925 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dec9de7d-967d-4cb8-bf5c-1651387285f1 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:41.328510 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-ec011f5c-12b9-4743-9f0d-c0403ac578ee tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:41.335042 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-dec9de7d-967d-4cb8-bf5c-1651387285f1 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:41.335639 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ec011f5c-12b9-4743-9f0d-c0403ac578ee tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129" status: 200 len: 1314 microversion: 2.1 time: 0.153123 Nov 21 13:56:41.336238 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 375/737] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:41 2021] GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:41.340609 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-e6c265e2-c548-4860-89c1-abd6be630596 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:41.341558 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-e6c265e2-c548-4860-89c1-abd6be630596 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:41.343270 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-dec9de7d-967d-4cb8-bf5c-1651387285f1 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1569 microversion: 2.1 time: 0.154839 Nov 21 13:56:41.343950 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 363/738] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:41 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:56:41.348558 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-233a92a0-9be5-4088-9927-30372d8b19b8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:41.349451 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-233a92a0-9be5-4088-9927-30372d8b19b8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:41.350978 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e6c265e2-c548-4860-89c1-abd6be630596 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:41.351435 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e6c265e2-c548-4860-89c1-abd6be630596 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:41.352365 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e6c265e2-c548-4860-89c1-abd6be630596 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:41.352859 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e6c265e2-c548-4860-89c1-abd6be630596 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:41.354998 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-233a92a0-9be5-4088-9927-30372d8b19b8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:41.355449 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-233a92a0-9be5-4088-9927-30372d8b19b8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:41.356264 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-233a92a0-9be5-4088-9927-30372d8b19b8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:41.356702 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-233a92a0-9be5-4088-9927-30372d8b19b8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:41.441648 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-e6c265e2-c548-4860-89c1-abd6be630596 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 28477 microversion: 2.20 time: 0.104101 Nov 21 13:56:41.442274 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 376/739] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:41 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 28477 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:56:41.454145 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-233a92a0-9be5-4088-9927-30372d8b19b8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 14 microversion: 2.1 time: 0.108746 Nov 21 13:56:41.454832 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 364/740] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:41 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:56:42.352394 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-022bf072-7979-4192-8ae4-6b7b02c08465 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:42.353091 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-022bf072-7979-4192-8ae4-6b7b02c08465 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: e9dc0276-9434-487d-a1ac-e95f0c499129] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:42.360099 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-022bf072-7979-4192-8ae4-6b7b02c08465 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:42.360581 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-022bf072-7979-4192-8ae4-6b7b02c08465 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:42.361358 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-022bf072-7979-4192-8ae4-6b7b02c08465 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:42.361793 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-022bf072-7979-4192-8ae4-6b7b02c08465 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:42.361916 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-184057e4-5c1d-42a8-aee1-36e6d1f5f173 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:42.362597 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-184057e4-5c1d-42a8-aee1-36e6d1f5f173 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:42.369597 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-184057e4-5c1d-42a8-aee1-36e6d1f5f173 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:42.370044 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-184057e4-5c1d-42a8-aee1-36e6d1f5f173 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:42.370819 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-184057e4-5c1d-42a8-aee1-36e6d1f5f173 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:42.371247 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-184057e4-5c1d-42a8-aee1-36e6d1f5f173 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:42.638357 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-022bf072-7979-4192-8ae4-6b7b02c08465 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:42.643546 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-184057e4-5c1d-42a8-aee1-36e6d1f5f173 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:42.645943 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-022bf072-7979-4192-8ae4-6b7b02c08465 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129" status: 200 len: 1314 microversion: 2.1 time: 0.297569 Nov 21 13:56:42.646936 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 377/741] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:42 2021] GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:42.650949 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-9e051f28-3d4c-4cc1-b835-176a6befd558 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:42.651088 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-184057e4-5c1d-42a8-aee1-36e6d1f5f173 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1569 microversion: 2.1 time: 0.294411 Nov 21 13:56:42.651555 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 365/742] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:42 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1569 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:56:42.652027 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-9e051f28-3d4c-4cc1-b835-176a6befd558 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:42.656615 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-12f7d95c-3b2b-4af1-98e8-14703b0bf233 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:42.657589 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-12f7d95c-3b2b-4af1-98e8-14703b0bf233 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:42.660365 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9e051f28-3d4c-4cc1-b835-176a6befd558 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:42.660819 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9e051f28-3d4c-4cc1-b835-176a6befd558 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:42.661614 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9e051f28-3d4c-4cc1-b835-176a6befd558 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:42.662277 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9e051f28-3d4c-4cc1-b835-176a6befd558 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:42.663182 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-12f7d95c-3b2b-4af1-98e8-14703b0bf233 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:42.663628 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-12f7d95c-3b2b-4af1-98e8-14703b0bf233 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:42.664431 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-12f7d95c-3b2b-4af1-98e8-14703b0bf233 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:42.664864 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-12f7d95c-3b2b-4af1-98e8-14703b0bf233 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:42.743658 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-9e051f28-3d4c-4cc1-b835-176a6befd558 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 28645 microversion: 2.20 time: 0.095927 Nov 21 13:56:42.746166 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 378/743] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:42 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 28645 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:56:42.746334 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-12f7d95c-3b2b-4af1-98e8-14703b0bf233 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 14 microversion: 2.1 time: 0.092177 Nov 21 13:56:42.746334 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 366/744] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:42 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:56:43.663418 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-eb488dbc-0ec7-45ab-a8c2-af0ef1375d95 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:43.664133 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-eb488dbc-0ec7-45ab-a8c2-af0ef1375d95 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: e9dc0276-9434-487d-a1ac-e95f0c499129] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:43.668161 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a33dea3d-6f91-46e6-a366-89edfe931bfd tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:43.668856 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a33dea3d-6f91-46e6-a366-89edfe931bfd tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:43.670983 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-eb488dbc-0ec7-45ab-a8c2-af0ef1375d95 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:43.671429 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-eb488dbc-0ec7-45ab-a8c2-af0ef1375d95 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:43.672318 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-eb488dbc-0ec7-45ab-a8c2-af0ef1375d95 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:43.672748 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-eb488dbc-0ec7-45ab-a8c2-af0ef1375d95 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:43.676888 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a33dea3d-6f91-46e6-a366-89edfe931bfd tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:43.677348 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a33dea3d-6f91-46e6-a366-89edfe931bfd tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:43.678136 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a33dea3d-6f91-46e6-a366-89edfe931bfd tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:43.678572 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a33dea3d-6f91-46e6-a366-89edfe931bfd tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:43.810275 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-eb488dbc-0ec7-45ab-a8c2-af0ef1375d95 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:43.814334 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a33dea3d-6f91-46e6-a366-89edfe931bfd tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:43.818278 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-eb488dbc-0ec7-45ab-a8c2-af0ef1375d95 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129" status: 200 len: 1498 microversion: 2.1 time: 0.158928 Nov 21 13:56:43.818884 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 379/745] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:43 2021] GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129 => generated 1498 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:43.822124 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a33dea3d-6f91-46e6-a366-89edfe931bfd tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1569 microversion: 2.1 time: 0.157983 Nov 21 13:56:43.822813 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 367/746] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:43 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:56:43.823410 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2ea9bc57-b9ee-4ac6-9638-68ec381a87b1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:43.824330 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-2ea9bc57-b9ee-4ac6-9638-68ec381a87b1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:43.826942 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-49c5a98d-3803-4382-991e-103fadaf67c8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:43.827923 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-49c5a98d-3803-4382-991e-103fadaf67c8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:43.832180 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2ea9bc57-b9ee-4ac6-9638-68ec381a87b1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:43.832746 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2ea9bc57-b9ee-4ac6-9638-68ec381a87b1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:43.833642 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2ea9bc57-b9ee-4ac6-9638-68ec381a87b1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:43.834331 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2ea9bc57-b9ee-4ac6-9638-68ec381a87b1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:43.835116 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-49c5a98d-3803-4382-991e-103fadaf67c8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:43.835580 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-49c5a98d-3803-4382-991e-103fadaf67c8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:43.836397 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-49c5a98d-3803-4382-991e-103fadaf67c8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:43.836835 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-49c5a98d-3803-4382-991e-103fadaf67c8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:43.906844 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-2ea9bc57-b9ee-4ac6-9638-68ec381a87b1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 28645 microversion: 2.20 time: 0.086354 Nov 21 13:56:43.908028 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 380/747] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:43 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 28645 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:56:43.916734 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-49c5a98d-3803-4382-991e-103fadaf67c8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 14 microversion: 2.1 time: 0.092843 Nov 21 13:56:43.917370 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 368/748] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:43 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:56:44.281171 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-c186cd2a-774b-45f8-a91e-f41ce03bc4c2 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:44.281763 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-c186cd2a-774b-45f8-a91e-f41ce03bc4c2 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: e9dc0276-9434-487d-a1ac-e95f0c499129] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:44.289403 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c186cd2a-774b-45f8-a91e-f41ce03bc4c2 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:44.289853 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c186cd2a-774b-45f8-a91e-f41ce03bc4c2 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:44.290828 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c186cd2a-774b-45f8-a91e-f41ce03bc4c2 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:44.291060 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c186cd2a-774b-45f8-a91e-f41ce03bc4c2 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:44.316752 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-c186cd2a-774b-45f8-a91e-f41ce03bc4c2 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: e9dc0276-9434-487d-a1ac-e95f0c499129] Going to try to terminate instance {{(pid=122564) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 21 13:56:44.386071 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-c186cd2a-774b-45f8-a91e-f41ce03bc4c2 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "DELETE /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129" status: 204 len: 0 microversion: 2.1 time: 0.108643 Nov 21 13:56:44.386560 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 381/749] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 13:56:44 2021] DELETE /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 13:56:44.395639 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-58028f76-0d7e-4b18-b872-f54c9a4bb7cb tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:44.396358 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-58028f76-0d7e-4b18-b872-f54c9a4bb7cb tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: e9dc0276-9434-487d-a1ac-e95f0c499129] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:44.403161 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-58028f76-0d7e-4b18-b872-f54c9a4bb7cb tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:44.403607 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-58028f76-0d7e-4b18-b872-f54c9a4bb7cb tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:44.404471 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-58028f76-0d7e-4b18-b872-f54c9a4bb7cb tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:44.404903 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-58028f76-0d7e-4b18-b872-f54c9a4bb7cb tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:44.533286 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-58028f76-0d7e-4b18-b872-f54c9a4bb7cb tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:44.540942 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-58028f76-0d7e-4b18-b872-f54c9a4bb7cb tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129" status: 200 len: 1504 microversion: 2.1 time: 0.149939 Nov 21 13:56:44.541490 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 369/750] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:44 2021] GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:44.839782 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-f3496de0-ab55-4cce-b759-fc534ddc4339 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:44.840502 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-f3496de0-ab55-4cce-b759-fc534ddc4339 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:44.846680 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f3496de0-ab55-4cce-b759-fc534ddc4339 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:44.847128 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f3496de0-ab55-4cce-b759-fc534ddc4339 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:44.847930 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f3496de0-ab55-4cce-b759-fc534ddc4339 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:44.848367 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f3496de0-ab55-4cce-b759-fc534ddc4339 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:44.918433 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-fad03ac9-d084-4994-b00d-d7c6727c28eb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:44.919341 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-fad03ac9-d084-4994-b00d-d7c6727c28eb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:44.926116 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fad03ac9-d084-4994-b00d-d7c6727c28eb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:44.926568 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fad03ac9-d084-4994-b00d-d7c6727c28eb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:44.927363 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fad03ac9-d084-4994-b00d-d7c6727c28eb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:44.927829 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fad03ac9-d084-4994-b00d-d7c6727c28eb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:44.984448 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-f3496de0-ab55-4cce-b759-fc534ddc4339 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:44.996385 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-fad03ac9-d084-4994-b00d-d7c6727c28eb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 28645 microversion: 2.20 time: 0.081378 Nov 21 13:56:44.996578 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-f3496de0-ab55-4cce-b759-fc534ddc4339 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1569 microversion: 2.1 time: 0.160568 Nov 21 13:56:45.000534 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 370/751] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:44 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 28645 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:56:45.000683 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 382/752] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:44 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:45.002983 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-69e399c8-f9ca-43d4-84d3-e6c8e9898915 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:45.003999 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-69e399c8-f9ca-43d4-84d3-e6c8e9898915 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:45.011006 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-69e399c8-f9ca-43d4-84d3-e6c8e9898915 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:45.011458 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-69e399c8-f9ca-43d4-84d3-e6c8e9898915 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:45.012275 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-69e399c8-f9ca-43d4-84d3-e6c8e9898915 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:45.012715 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-69e399c8-f9ca-43d4-84d3-e6c8e9898915 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:45.085501 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-69e399c8-f9ca-43d4-84d3-e6c8e9898915 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 14 microversion: 2.1 time: 0.087035 Nov 21 13:56:45.086113 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 371/753] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:44 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:56:45.558006 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-0cf124c1-9141-4e71-80ea-665a00c0908d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:45.558592 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-0cf124c1-9141-4e71-80ea-665a00c0908d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: e9dc0276-9434-487d-a1ac-e95f0c499129] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:45.565192 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0cf124c1-9141-4e71-80ea-665a00c0908d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:45.565646 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0cf124c1-9141-4e71-80ea-665a00c0908d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:45.566427 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0cf124c1-9141-4e71-80ea-665a00c0908d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:45.566867 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0cf124c1-9141-4e71-80ea-665a00c0908d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:45.693675 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-0cf124c1-9141-4e71-80ea-665a00c0908d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:45.700826 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-0cf124c1-9141-4e71-80ea-665a00c0908d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129" status: 200 len: 1504 microversion: 2.1 time: 0.146864 Nov 21 13:56:45.701379 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 383/754] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:45 2021] GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129 => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:46.011732 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-73310f1e-a82d-4617-a90f-00693b9aa16a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:46.012800 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-73310f1e-a82d-4617-a90f-00693b9aa16a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:46.014033 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-e720c715-af8d-4493-a65d-b5aa15959a8d tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:46.014655 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-e720c715-af8d-4493-a65d-b5aa15959a8d tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:46.020180 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-73310f1e-a82d-4617-a90f-00693b9aa16a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:46.021713 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-73310f1e-a82d-4617-a90f-00693b9aa16a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:46.021854 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e720c715-af8d-4493-a65d-b5aa15959a8d tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:46.021965 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-73310f1e-a82d-4617-a90f-00693b9aa16a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:46.021965 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-73310f1e-a82d-4617-a90f-00693b9aa16a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:46.022112 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e720c715-af8d-4493-a65d-b5aa15959a8d tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:46.022604 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e720c715-af8d-4493-a65d-b5aa15959a8d tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:46.023044 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e720c715-af8d-4493-a65d-b5aa15959a8d tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:46.107667 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-73310f1e-a82d-4617-a90f-00693b9aa16a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 28645 microversion: 2.20 time: 0.099899 Nov 21 13:56:46.109028 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 372/755] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:46 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 28645 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:56:46.113355 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-07b605a6-77c3-449f-a17f-92aa615887f2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:46.114362 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-07b605a6-77c3-449f-a17f-92aa615887f2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:46.121174 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-07b605a6-77c3-449f-a17f-92aa615887f2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:46.121628 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-07b605a6-77c3-449f-a17f-92aa615887f2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:46.122467 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-07b605a6-77c3-449f-a17f-92aa615887f2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:46.122864 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-07b605a6-77c3-449f-a17f-92aa615887f2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:46.157730 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-e720c715-af8d-4493-a65d-b5aa15959a8d tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:46.165052 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-e720c715-af8d-4493-a65d-b5aa15959a8d tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1569 microversion: 2.1 time: 0.154707 Nov 21 13:56:46.165616 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 384/756] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:46 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:56:46.194009 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-07b605a6-77c3-449f-a17f-92aa615887f2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 14 microversion: 2.1 time: 0.084092 Nov 21 13:56:46.197132 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 373/757] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:46 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:56:46.544460 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-685343f3-2626-4f8a-b789-bd700da8c98b req-ceb9a76f-ded7-433b-ada5-6a47622b5797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9dc0276-9434-487d-a1ac-e95f0c499129", "name": "network-vif-deleted", "tag": "a98bf10e-b29e-4c77-8249-7c04d7ab12b9"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:46.546153 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:56:46.546153 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:56:46.555318 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-685343f3-2626-4f8a-b789-bd700da8c98b req-ceb9a76f-ded7-433b-ada5-6a47622b5797 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:46.555759 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-685343f3-2626-4f8a-b789-bd700da8c98b req-ceb9a76f-ded7-433b-ada5-6a47622b5797 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:46.567040 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-685343f3-2626-4f8a-b789-bd700da8c98b req-ceb9a76f-ded7-433b-ada5-6a47622b5797 service nova] Creating event network-vif-deleted:a98bf10e-b29e-4c77-8249-7c04d7ab12b9 for instance e9dc0276-9434-487d-a1ac-e95f0c499129 on hv-cinder-76845 Nov 21 13:56:46.573123 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-685343f3-2626-4f8a-b789-bd700da8c98b req-ceb9a76f-ded7-433b-ada5-6a47622b5797 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032558 Nov 21 13:56:46.573706 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 385/758] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:56:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:56:46.718834 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-305bd711-41e4-4eee-b7f4-b43e12aa45c4 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:46.719558 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-305bd711-41e4-4eee-b7f4-b43e12aa45c4 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: e9dc0276-9434-487d-a1ac-e95f0c499129] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:46.727149 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-305bd711-41e4-4eee-b7f4-b43e12aa45c4 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:46.727598 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-305bd711-41e4-4eee-b7f4-b43e12aa45c4 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:46.728409 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-305bd711-41e4-4eee-b7f4-b43e12aa45c4 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:46.728849 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-305bd711-41e4-4eee-b7f4-b43e12aa45c4 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:46.759434 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-305bd711-41e4-4eee-b7f4-b43e12aa45c4 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:46.759912 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-305bd711-41e4-4eee-b7f4-b43e12aa45c4 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:46.760360 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.objects.instance [None req-305bd711-41e4-4eee-b7f4-b43e12aa45c4 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lazy-loading 'fault' on Instance uuid e9dc0276-9434-487d-a1ac-e95f0c499129 {{(pid=122565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:56:46.799680 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-305bd711-41e4-4eee-b7f4-b43e12aa45c4 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27b5cb18eb046a09196a7f26e4fde3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:46.806725 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-305bd711-41e4-4eee-b7f4-b43e12aa45c4 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129" status: 200 len: 1304 microversion: 2.1 time: 0.091959 Nov 21 13:56:46.807289 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 374/759] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:46 2021] GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129 => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:47.122080 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-333b1dcd-015e-4045-9dca-9f21bf8cb2ea tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:47.123831 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-333b1dcd-015e-4045-9dca-9f21bf8cb2ea tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:47.130609 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-333b1dcd-015e-4045-9dca-9f21bf8cb2ea tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:47.131063 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-333b1dcd-015e-4045-9dca-9f21bf8cb2ea tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:47.131864 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-333b1dcd-015e-4045-9dca-9f21bf8cb2ea tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:47.132303 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-333b1dcd-015e-4045-9dca-9f21bf8cb2ea tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:47.182204 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-40ff6796-e947-433d-b2d5-46ade5bc69ec tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:47.182942 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-40ff6796-e947-433d-b2d5-46ade5bc69ec tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:47.189432 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-40ff6796-e947-433d-b2d5-46ade5bc69ec tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:47.189952 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-40ff6796-e947-433d-b2d5-46ade5bc69ec tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:47.190790 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-40ff6796-e947-433d-b2d5-46ade5bc69ec tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:47.191228 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-40ff6796-e947-433d-b2d5-46ade5bc69ec tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:47.233625 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-333b1dcd-015e-4045-9dca-9f21bf8cb2ea tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 29710 microversion: 2.20 time: 0.118123 Nov 21 13:56:47.234425 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 386/760] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:47 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 29710 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:56:47.239860 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-650caffd-30dd-479b-bff6-a7cf5e8df460 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:47.240849 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-650caffd-30dd-479b-bff6-a7cf5e8df460 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:47.247668 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-650caffd-30dd-479b-bff6-a7cf5e8df460 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:47.248149 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-650caffd-30dd-479b-bff6-a7cf5e8df460 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:47.248932 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-650caffd-30dd-479b-bff6-a7cf5e8df460 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:47.249367 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-650caffd-30dd-479b-bff6-a7cf5e8df460 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:47.324641 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-40ff6796-e947-433d-b2d5-46ade5bc69ec tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:47.327670 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-650caffd-30dd-479b-bff6-a7cf5e8df460 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 9658 microversion: 2.1 time: 0.091672 Nov 21 13:56:47.328551 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 387/761] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:47 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 9658 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:47.332492 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-40ff6796-e947-433d-b2d5-46ade5bc69ec tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1569 microversion: 2.1 time: 0.153921 Nov 21 13:56:47.333049 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 375/762] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:47 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:56:47.822989 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-82da97b4-413e-4048-b7a9-52bf081c5d8b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:47.823685 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-82da97b4-413e-4048-b7a9-52bf081c5d8b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] [instance: e9dc0276-9434-487d-a1ac-e95f0c499129] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:47.830493 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-82da97b4-413e-4048-b7a9-52bf081c5d8b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:47.830943 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-82da97b4-413e-4048-b7a9-52bf081c5d8b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:47.831717 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-82da97b4-413e-4048-b7a9-52bf081c5d8b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:47.832186 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-82da97b4-413e-4048-b7a9-52bf081c5d8b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:47.845682 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.wsgi [None req-82da97b4-413e-4048-b7a9-52bf081c5d8b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] HTTP exception thrown: Instance e9dc0276-9434-487d-a1ac-e95f0c499129 could not be found. Nov 21 13:56:47.846257 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-82da97b4-413e-4048-b7a9-52bf081c5d8b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Returning 404 to user: Instance e9dc0276-9434-487d-a1ac-e95f0c499129 could not be found. {{(pid=122564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:56:47.847060 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-82da97b4-413e-4048-b7a9-52bf081c5d8b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129" status: 404 len: 111 microversion: 2.1 time: 0.028120 Nov 21 13:56:47.847578 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 388/763] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:47 2021] GET /compute/v2.1/servers/e9dc0276-9434-487d-a1ac-e95f0c499129 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:56:48.245793 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-d5d5a89a-0d29-4cdf-adc3-24e2e9461262 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:48.246814 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-d5d5a89a-0d29-4cdf-adc3-24e2e9461262 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:48.253498 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d5d5a89a-0d29-4cdf-adc3-24e2e9461262 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:48.254020 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d5d5a89a-0d29-4cdf-adc3-24e2e9461262 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:48.254933 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d5d5a89a-0d29-4cdf-adc3-24e2e9461262 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:48.255435 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d5d5a89a-0d29-4cdf-adc3-24e2e9461262 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:48.341448 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-3d8f44a0-6867-4ebc-b5bd-dd0939ad5186 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:48.342376 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3d8f44a0-6867-4ebc-b5bd-dd0939ad5186 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:48.344359 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-d5d5a89a-0d29-4cdf-adc3-24e2e9461262 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 31485 microversion: 2.20 time: 0.100299 Nov 21 13:56:48.345799 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 376/764] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:48 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 31485 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:56:48.352465 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-97ff18e8-812c-4371-bcd3-7c98a1f96b5f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:48.353279 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-97ff18e8-812c-4371-bcd3-7c98a1f96b5f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:48.354660 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3d8f44a0-6867-4ebc-b5bd-dd0939ad5186 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:48.355297 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3d8f44a0-6867-4ebc-b5bd-dd0939ad5186 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:48.356300 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3d8f44a0-6867-4ebc-b5bd-dd0939ad5186 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:48.356938 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3d8f44a0-6867-4ebc-b5bd-dd0939ad5186 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:48.361035 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-97ff18e8-812c-4371-bcd3-7c98a1f96b5f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:48.361568 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-97ff18e8-812c-4371-bcd3-7c98a1f96b5f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:48.362458 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-97ff18e8-812c-4371-bcd3-7c98a1f96b5f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:48.363117 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-97ff18e8-812c-4371-bcd3-7c98a1f96b5f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:48.446868 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-3d8f44a0-6867-4ebc-b5bd-dd0939ad5186 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 16235 microversion: 2.1 time: 0.110782 Nov 21 13:56:48.450772 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 389/765] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:48 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 16235 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:56:48.540722 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-97ff18e8-812c-4371-bcd3-7c98a1f96b5f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:48.548349 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-97ff18e8-812c-4371-bcd3-7c98a1f96b5f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1569 microversion: 2.1 time: 0.200453 Nov 21 13:56:48.549007 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 377/766] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:48 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:49.357033 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-d4382af8-8560-4387-9738-0ffc35d4df65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:49.358025 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-d4382af8-8560-4387-9738-0ffc35d4df65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:49.364880 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d4382af8-8560-4387-9738-0ffc35d4df65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:49.365334 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d4382af8-8560-4387-9738-0ffc35d4df65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:49.366113 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d4382af8-8560-4387-9738-0ffc35d4df65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:49.366546 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d4382af8-8560-4387-9738-0ffc35d4df65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:49.510693 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-5b68cc74-b746-49af-97da-91a68b673333 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:49.511670 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-5b68cc74-b746-49af-97da-91a68b673333 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:49.518061 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5b68cc74-b746-49af-97da-91a68b673333 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:49.518505 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5b68cc74-b746-49af-97da-91a68b673333 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:49.519273 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5b68cc74-b746-49af-97da-91a68b673333 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:49.519703 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5b68cc74-b746-49af-97da-91a68b673333 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:51.647866 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-5b68cc74-b746-49af-97da-91a68b673333 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 22021 microversion: 2.1 time: 2.193004 Nov 21 13:56:51.648611 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 378/767] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:49 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 22021 bytes in 2195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 13:56:51.653413 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-578e7ad4-9c2b-4462-9881-2a8f4b3aab5a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:51.654097 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-578e7ad4-9c2b-4462-9881-2a8f4b3aab5a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:51.661745 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-578e7ad4-9c2b-4462-9881-2a8f4b3aab5a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:51.662203 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-578e7ad4-9c2b-4462-9881-2a8f4b3aab5a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:51.662986 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-578e7ad4-9c2b-4462-9881-2a8f4b3aab5a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:51.663421 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-578e7ad4-9c2b-4462-9881-2a8f4b3aab5a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:51.664333 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-d4382af8-8560-4387-9738-0ffc35d4df65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 34209 microversion: 2.20 time: 2.311231 Nov 21 13:56:51.668047 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 390/768] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:49 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 34209 bytes in 2313 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:56:51.799871 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-578e7ad4-9c2b-4462-9881-2a8f4b3aab5a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:51.807444 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-578e7ad4-9c2b-4462-9881-2a8f4b3aab5a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1569 microversion: 2.1 time: 0.157754 Nov 21 13:56:51.808034 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 379/769] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:51 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:52.662589 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-4762d047-e5dc-41cd-86d5-8e6b6b9179c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:52.663983 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-4762d047-e5dc-41cd-86d5-8e6b6b9179c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:52.672079 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4762d047-e5dc-41cd-86d5-8e6b6b9179c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:52.673862 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4762d047-e5dc-41cd-86d5-8e6b6b9179c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:52.674882 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4762d047-e5dc-41cd-86d5-8e6b6b9179c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:52.675323 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4762d047-e5dc-41cd-86d5-8e6b6b9179c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:52.677294 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ad026cee-f8da-479e-b54a-d6997f80344d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:52.678659 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ad026cee-f8da-479e-b54a-d6997f80344d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:52.686563 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ad026cee-f8da-479e-b54a-d6997f80344d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:52.687568 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ad026cee-f8da-479e-b54a-d6997f80344d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:52.689477 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ad026cee-f8da-479e-b54a-d6997f80344d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:52.690122 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ad026cee-f8da-479e-b54a-d6997f80344d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:52.760352 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-4762d047-e5dc-41cd-86d5-8e6b6b9179c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 23186 microversion: 2.1 time: 0.104324 Nov 21 13:56:52.760993 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 391/770] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:52 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 23186 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:56:52.781170 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ad026cee-f8da-479e-b54a-d6997f80344d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 34633 microversion: 2.20 time: 0.108670 Nov 21 13:56:52.782677 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 380/771] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:52 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 34633 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:56:52.824996 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-855febc5-d9ed-496f-b0ec-62a1e9db8db5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:52.825820 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-855febc5-d9ed-496f-b0ec-62a1e9db8db5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:52.833289 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-855febc5-d9ed-496f-b0ec-62a1e9db8db5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:52.834675 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-855febc5-d9ed-496f-b0ec-62a1e9db8db5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:52.835704 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-855febc5-d9ed-496f-b0ec-62a1e9db8db5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:52.836185 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-855febc5-d9ed-496f-b0ec-62a1e9db8db5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:52.983373 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-855febc5-d9ed-496f-b0ec-62a1e9db8db5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:52.991964 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-855febc5-d9ed-496f-b0ec-62a1e9db8db5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1569 microversion: 2.1 time: 0.170952 Nov 21 13:56:52.992536 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 392/772] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:52 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:53.783066 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c1750069-d82f-42f9-b328-ebbe5af3b500 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:53.796404 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-f97172b6-da10-4817-9fd9-7bf4d127b56c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:53.797338 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-f97172b6-da10-4817-9fd9-7bf4d127b56c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:53.813353 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f97172b6-da10-4817-9fd9-7bf4d127b56c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:53.814877 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-c1750069-d82f-42f9-b328-ebbe5af3b500 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:53.820496 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f97172b6-da10-4817-9fd9-7bf4d127b56c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:53.821447 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f97172b6-da10-4817-9fd9-7bf4d127b56c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:53.823837 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c1750069-d82f-42f9-b328-ebbe5af3b500 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:53.824406 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f97172b6-da10-4817-9fd9-7bf4d127b56c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:53.829394 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c1750069-d82f-42f9-b328-ebbe5af3b500 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:53.831149 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c1750069-d82f-42f9-b328-ebbe5af3b500 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:53.832014 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c1750069-d82f-42f9-b328-ebbe5af3b500 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:53.946888 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-f97172b6-da10-4817-9fd9-7bf4d127b56c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 35332 microversion: 2.20 time: 0.156332 Nov 21 13:56:53.952844 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 393/773] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:53 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 35332 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:56:53.962348 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c1750069-d82f-42f9-b328-ebbe5af3b500 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 24142 microversion: 2.1 time: 0.190807 Nov 21 13:56:53.967635 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 381/774] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:53 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 24142 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:56:54.010489 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-da7b9fd4-bffb-4794-a866-6580ae678469 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:54.011401 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-da7b9fd4-bffb-4794-a866-6580ae678469 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:54.018719 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-da7b9fd4-bffb-4794-a866-6580ae678469 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:54.019476 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-da7b9fd4-bffb-4794-a866-6580ae678469 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:54.020621 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-da7b9fd4-bffb-4794-a866-6580ae678469 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:54.021296 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-da7b9fd4-bffb-4794-a866-6580ae678469 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:54.174726 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-da7b9fd4-bffb-4794-a866-6580ae678469 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:54.182610 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-da7b9fd4-bffb-4794-a866-6580ae678469 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1510 microversion: 2.1 time: 0.176464 Nov 21 13:56:54.183093 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 394/775] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:54 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:54.201713 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ce02a582-e94d-4a0f-8efb-2f6fa43e9d1c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:54.202700 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ce02a582-e94d-4a0f-8efb-2f6fa43e9d1c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:54.212784 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ce02a582-e94d-4a0f-8efb-2f6fa43e9d1c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:54.213413 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ce02a582-e94d-4a0f-8efb-2f6fa43e9d1c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:54.214405 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ce02a582-e94d-4a0f-8efb-2f6fa43e9d1c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:54.215138 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ce02a582-e94d-4a0f-8efb-2f6fa43e9d1c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:54.341082 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ce02a582-e94d-4a0f-8efb-2f6fa43e9d1c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "POST /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06/action" status: 202 len: 0 microversion: 2.1 time: 0.142605 Nov 21 13:56:54.353190 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-e650610b-4a50-4bce-8740-190ca9f8fefb tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:54.353883 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-e650610b-4a50-4bce-8740-190ca9f8fefb tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:54.358080 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 382/776] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:54 2021] POST /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:56:54.362516 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e650610b-4a50-4bce-8740-190ca9f8fefb tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:54.362977 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e650610b-4a50-4bce-8740-190ca9f8fefb tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:54.363918 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e650610b-4a50-4bce-8740-190ca9f8fefb tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:54.364535 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e650610b-4a50-4bce-8740-190ca9f8fefb tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:54.533154 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-e650610b-4a50-4bce-8740-190ca9f8fefb tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:54.543656 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-e650610b-4a50-4bce-8740-190ca9f8fefb tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1518 microversion: 2.1 time: 0.195280 Nov 21 13:56:54.545172 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 395/777] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:54 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1518 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:54.961030 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-b7a176d8-804c-402c-8994-b242d898ce03 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:54.963384 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-b7a176d8-804c-402c-8994-b242d898ce03 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:54.975862 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-6ecc5e58-0af1-4045-a403-3552d21ba729 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:54.977871 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-6ecc5e58-0af1-4045-a403-3552d21ba729 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:54.986174 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b7a176d8-804c-402c-8994-b242d898ce03 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:54.989256 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b7a176d8-804c-402c-8994-b242d898ce03 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:54.990071 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b7a176d8-804c-402c-8994-b242d898ce03 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:54.990511 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b7a176d8-804c-402c-8994-b242d898ce03 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:54.993123 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6ecc5e58-0af1-4045-a403-3552d21ba729 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:54.993793 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6ecc5e58-0af1-4045-a403-3552d21ba729 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:54.994780 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6ecc5e58-0af1-4045-a403-3552d21ba729 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:54.995382 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6ecc5e58-0af1-4045-a403-3552d21ba729 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:55.120138 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-b7a176d8-804c-402c-8994-b242d898ce03 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 36506 microversion: 2.20 time: 0.162990 Nov 21 13:56:55.126646 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 383/778] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:54 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 36506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:56:55.134547 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-6ecc5e58-0af1-4045-a403-3552d21ba729 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 25357 microversion: 2.1 time: 0.163052 Nov 21 13:56:55.141761 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 396/779] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:54 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 25357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:56:55.567552 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-1303e674-da9e-439a-a012-45e5c464f11f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:55.570119 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-1303e674-da9e-439a-a012-45e5c464f11f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:55.583133 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1303e674-da9e-439a-a012-45e5c464f11f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:55.583719 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1303e674-da9e-439a-a012-45e5c464f11f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:55.585821 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1303e674-da9e-439a-a012-45e5c464f11f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:55.586917 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1303e674-da9e-439a-a012-45e5c464f11f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:55.787387 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-1303e674-da9e-439a-a012-45e5c464f11f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:55.796125 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-1303e674-da9e-439a-a012-45e5c464f11f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1520 microversion: 2.1 time: 0.236723 Nov 21 13:56:55.797059 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 384/780] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:55 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:56.135110 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-abb2f56e-eb64-40e0-953d-0a1579c536a5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:56.136278 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-abb2f56e-eb64-40e0-953d-0a1579c536a5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:56.148558 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-72af7a65-37d9-40dc-8b18-2d8f45f07f68 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:56.150713 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-72af7a65-37d9-40dc-8b18-2d8f45f07f68 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:56.152635 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-abb2f56e-eb64-40e0-953d-0a1579c536a5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:56.152960 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-abb2f56e-eb64-40e0-953d-0a1579c536a5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:56.153814 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-abb2f56e-eb64-40e0-953d-0a1579c536a5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:56.154251 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-abb2f56e-eb64-40e0-953d-0a1579c536a5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:56.157991 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-72af7a65-37d9-40dc-8b18-2d8f45f07f68 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:56.158761 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-72af7a65-37d9-40dc-8b18-2d8f45f07f68 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:56.160203 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-72af7a65-37d9-40dc-8b18-2d8f45f07f68 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:56.160994 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-72af7a65-37d9-40dc-8b18-2d8f45f07f68 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:56.251635 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-abb2f56e-eb64-40e0-953d-0a1579c536a5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 37476 microversion: 2.20 time: 0.120154 Nov 21 13:56:56.252330 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 397/781] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:56 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 37476 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:56:56.279858 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-72af7a65-37d9-40dc-8b18-2d8f45f07f68 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 26298 microversion: 2.1 time: 0.134953 Nov 21 13:56:56.292496 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 385/782] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:56 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 26298 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 13:56:56.816253 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-173e9062-fa54-483b-a4cd-3ad3832b6c46 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:56.818129 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-173e9062-fa54-483b-a4cd-3ad3832b6c46 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:56.832530 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-173e9062-fa54-483b-a4cd-3ad3832b6c46 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:56.837015 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-173e9062-fa54-483b-a4cd-3ad3832b6c46 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:56.841732 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-173e9062-fa54-483b-a4cd-3ad3832b6c46 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:56.842436 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-173e9062-fa54-483b-a4cd-3ad3832b6c46 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:57.047386 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-c3d0df36-aeac-4699-8d19-0469b7b64b07 req-24f8f363-4d52-4c3d-ac03-04f438c27e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2707c966-28e3-43ba-9241-d5629ba92b06", "name": "network-vif-unplugged", "status": "completed", "tag": "5907d47d-9ae0-44a4-adf8-9e5e784f851a"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:57.049639 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:56:57.049639 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:56:57.063361 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-c3d0df36-aeac-4699-8d19-0469b7b64b07 req-24f8f363-4d52-4c3d-ac03-04f438c27e1d service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:57.069691 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-c3d0df36-aeac-4699-8d19-0469b7b64b07 req-24f8f363-4d52-4c3d-ac03-04f438c27e1d service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:57.088453 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-173e9062-fa54-483b-a4cd-3ad3832b6c46 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:57.094258 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-c3d0df36-aeac-4699-8d19-0469b7b64b07 req-24f8f363-4d52-4c3d-ac03-04f438c27e1d service nova] Creating event network-vif-unplugged:5907d47d-9ae0-44a4-adf8-9e5e784f851a for instance 2707c966-28e3-43ba-9241-d5629ba92b06 on hv-cinder-76845 Nov 21 13:56:57.100662 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-c3d0df36-aeac-4699-8d19-0469b7b64b07 req-24f8f363-4d52-4c3d-ac03-04f438c27e1d service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057675 Nov 21 13:56:57.102087 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 386/783] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:56:57 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:56:57.102213 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-173e9062-fa54-483b-a4cd-3ad3832b6c46 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1576 microversion: 2.1 time: 0.291994 Nov 21 13:56:57.102954 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 398/784] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:56 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1576 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:57.299638 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-de7ad4f9-3f81-4a03-8f18-e547f1b22a41 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:57.301520 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-de7ad4f9-3f81-4a03-8f18-e547f1b22a41 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:57.308135 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-de7ad4f9-3f81-4a03-8f18-e547f1b22a41 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:57.308835 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-de7ad4f9-3f81-4a03-8f18-e547f1b22a41 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:57.309636 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-de7ad4f9-3f81-4a03-8f18-e547f1b22a41 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:57.310073 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-de7ad4f9-3f81-4a03-8f18-e547f1b22a41 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:57.395511 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-de7ad4f9-3f81-4a03-8f18-e547f1b22a41 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 27099 microversion: 2.1 time: 0.099887 Nov 21 13:56:57.396030 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-cc19340f-3393-41be-b292-5743ec593bc8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:57.397459 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 399/785] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:57 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 27099 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 13:56:57.400042 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-cc19340f-3393-41be-b292-5743ec593bc8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:57.411950 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cc19340f-3393-41be-b292-5743ec593bc8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:57.413474 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cc19340f-3393-41be-b292-5743ec593bc8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:57.415444 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cc19340f-3393-41be-b292-5743ec593bc8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:57.416614 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cc19340f-3393-41be-b292-5743ec593bc8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:57.521404 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-cc19340f-3393-41be-b292-5743ec593bc8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 38200 microversion: 2.20 time: 0.259718 Nov 21 13:56:57.523280 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 387/786] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:57 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 38200 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:56:58.121886 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-d0c87056-9b2a-45d3-a874-355b767c6bfb tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:58.123363 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-d0c87056-9b2a-45d3-a874-355b767c6bfb tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:58.135745 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d0c87056-9b2a-45d3-a874-355b767c6bfb tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:58.136219 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d0c87056-9b2a-45d3-a874-355b767c6bfb tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:58.137239 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d0c87056-9b2a-45d3-a874-355b767c6bfb tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:58.137882 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d0c87056-9b2a-45d3-a874-355b767c6bfb tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:58.314091 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-d0c87056-9b2a-45d3-a874-355b767c6bfb tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:58.324008 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-d0c87056-9b2a-45d3-a874-355b767c6bfb tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1576 microversion: 2.1 time: 0.208465 Nov 21 13:56:58.324676 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 400/787] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:58 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1576 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:58.409195 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-f7ee86f6-4ebc-4fba-9ff3-2c766e4a7857 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:58.410160 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-f7ee86f6-4ebc-4fba-9ff3-2c766e4a7857 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:58.417394 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f7ee86f6-4ebc-4fba-9ff3-2c766e4a7857 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:58.418090 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f7ee86f6-4ebc-4fba-9ff3-2c766e4a7857 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:58.419082 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f7ee86f6-4ebc-4fba-9ff3-2c766e4a7857 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:58.419695 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f7ee86f6-4ebc-4fba-9ff3-2c766e4a7857 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:58.509250 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-f7ee86f6-4ebc-4fba-9ff3-2c766e4a7857 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 27387 microversion: 2.1 time: 0.104643 Nov 21 13:56:58.510122 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 388/788] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:58 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 27387 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:56:58.534536 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-9293eee6-a317-4d11-8ffb-9e1c2a5653f5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:58.535503 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-9293eee6-a317-4d11-8ffb-9e1c2a5653f5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:58.542204 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9293eee6-a317-4d11-8ffb-9e1c2a5653f5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:58.542663 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9293eee6-a317-4d11-8ffb-9e1c2a5653f5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:58.543473 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9293eee6-a317-4d11-8ffb-9e1c2a5653f5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:58.543953 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9293eee6-a317-4d11-8ffb-9e1c2a5653f5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:58.610722 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-9293eee6-a317-4d11-8ffb-9e1c2a5653f5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 38200 microversion: 2.20 time: 0.080308 Nov 21 13:56:58.616640 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 401/789] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:58 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 38200 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:56:59.344206 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-3b3ba7dd-1886-4acd-b838-bb99ecf013dc tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:56:59.344928 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-3b3ba7dd-1886-4acd-b838-bb99ecf013dc tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:59.351764 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3b3ba7dd-1886-4acd-b838-bb99ecf013dc tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:59.352243 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3b3ba7dd-1886-4acd-b838-bb99ecf013dc tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:59.353030 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3b3ba7dd-1886-4acd-b838-bb99ecf013dc tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:59.353461 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3b3ba7dd-1886-4acd-b838-bb99ecf013dc tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:59.500908 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-3b3ba7dd-1886-4acd-b838-bb99ecf013dc tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:56:59.513115 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-3b3ba7dd-1886-4acd-b838-bb99ecf013dc tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1576 microversion: 2.1 time: 0.172837 Nov 21 13:56:59.522582 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 389/790] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:56:59 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:56:59.529050 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-208d96b2-6978-4dac-b345-1639b2431a80 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:59.531283 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-208d96b2-6978-4dac-b345-1639b2431a80 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:59.542889 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-208d96b2-6978-4dac-b345-1639b2431a80 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:59.543527 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-208d96b2-6978-4dac-b345-1639b2431a80 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:59.544401 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-208d96b2-6978-4dac-b345-1639b2431a80 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:59.544848 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-208d96b2-6978-4dac-b345-1639b2431a80 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:59.625628 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-f0d4193e-8637-4874-b2a5-004a3f6e3d4f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:56:59.626572 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-f0d4193e-8637-4874-b2a5-004a3f6e3d4f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:56:59.633347 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f0d4193e-8637-4874-b2a5-004a3f6e3d4f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:59.633928 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f0d4193e-8637-4874-b2a5-004a3f6e3d4f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:59.634799 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f0d4193e-8637-4874-b2a5-004a3f6e3d4f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:56:59.635317 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f0d4193e-8637-4874-b2a5-004a3f6e3d4f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:56:59.658960 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-208d96b2-6978-4dac-b345-1639b2431a80 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 27751 microversion: 2.1 time: 0.138616 Nov 21 13:56:59.660219 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 402/791] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:56:59 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 27751 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:56:59.713566 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-f0d4193e-8637-4874-b2a5-004a3f6e3d4f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 38200 microversion: 2.20 time: 0.091670 Nov 21 13:56:59.714841 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 390/792] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:56:59 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 38200 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:57:00.530610 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-4e32c79d-d93f-4cbf-83ff-6bd9fb323ea6 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:00.531312 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-4e32c79d-d93f-4cbf-83ff-6bd9fb323ea6 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:00.538266 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4e32c79d-d93f-4cbf-83ff-6bd9fb323ea6 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:00.538713 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4e32c79d-d93f-4cbf-83ff-6bd9fb323ea6 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:00.539496 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4e32c79d-d93f-4cbf-83ff-6bd9fb323ea6 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:00.539964 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4e32c79d-d93f-4cbf-83ff-6bd9fb323ea6 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:00.670483 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-d5b993b4-7be1-4444-9093-b41577644002 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:00.672319 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-d5b993b4-7be1-4444-9093-b41577644002 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:00.679791 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d5b993b4-7be1-4444-9093-b41577644002 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:00.680361 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d5b993b4-7be1-4444-9093-b41577644002 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:00.681232 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d5b993b4-7be1-4444-9093-b41577644002 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:00.681764 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d5b993b4-7be1-4444-9093-b41577644002 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:00.684430 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-4e32c79d-d93f-4cbf-83ff-6bd9fb323ea6 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:00.692580 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-4e32c79d-d93f-4cbf-83ff-6bd9fb323ea6 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1576 microversion: 2.1 time: 0.165880 Nov 21 13:57:00.694289 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 403/793] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:57:00 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:57:00.725042 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-67b017dd-1473-426a-a2ab-057947012580 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:00.725950 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-67b017dd-1473-426a-a2ab-057947012580 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:00.732734 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-67b017dd-1473-426a-a2ab-057947012580 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:00.733180 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-67b017dd-1473-426a-a2ab-057947012580 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:00.733972 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-67b017dd-1473-426a-a2ab-057947012580 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:00.734408 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-67b017dd-1473-426a-a2ab-057947012580 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:00.781071 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-d5b993b4-7be1-4444-9093-b41577644002 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 28232 microversion: 2.1 time: 0.114227 Nov 21 13:57:00.781626 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 391/794] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:57:00 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 28232 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:57:00.824606 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-67b017dd-1473-426a-a2ab-057947012580 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 200 len: 38343 microversion: 2.20 time: 0.102919 Nov 21 13:57:00.825385 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 404/795] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:57:00 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 38343 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:57:00.835830 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-bb567bee-8994-4720-9404-9af0f9e2b3dc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:00.836562 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-bb567bee-8994-4720-9404-9af0f9e2b3dc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:00.844404 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bb567bee-8994-4720-9404-9af0f9e2b3dc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:00.844903 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bb567bee-8994-4720-9404-9af0f9e2b3dc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:00.845708 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bb567bee-8994-4720-9404-9af0f9e2b3dc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:00.846146 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bb567bee-8994-4720-9404-9af0f9e2b3dc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:00.871913 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-bb567bee-8994-4720-9404-9af0f9e2b3dc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/ips" status: 200 len: 152 microversion: 2.20 time: 0.040051 Nov 21 13:57:00.872805 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 392/796] 10.222.0.11 () {60 vars in 1288 bytes} [Sun Nov 21 13:57:00 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:57:01.710892 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-8de9555b-b626-4512-94cc-1a4037173017 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:01.711771 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-8de9555b-b626-4512-94cc-1a4037173017 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:01.719355 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8de9555b-b626-4512-94cc-1a4037173017 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:01.719895 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8de9555b-b626-4512-94cc-1a4037173017 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:01.720651 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8de9555b-b626-4512-94cc-1a4037173017 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:01.721093 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8de9555b-b626-4512-94cc-1a4037173017 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:01.793445 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-3c761a8d-71ad-40bf-9655-785a8a0f84a5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:01.794371 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-3c761a8d-71ad-40bf-9655-785a8a0f84a5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:01.800998 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3c761a8d-71ad-40bf-9655-785a8a0f84a5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:01.801537 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3c761a8d-71ad-40bf-9655-785a8a0f84a5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:01.802411 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3c761a8d-71ad-40bf-9655-785a8a0f84a5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:01.803091 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3c761a8d-71ad-40bf-9655-785a8a0f84a5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:01.875085 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-3c761a8d-71ad-40bf-9655-785a8a0f84a5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 28232 microversion: 2.1 time: 0.084968 Nov 21 13:57:01.880777 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 393/797] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:57:01 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 28232 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:57:01.920195 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-8de9555b-b626-4512-94cc-1a4037173017 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:01.927756 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-8de9555b-b626-4512-94cc-1a4037173017 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1576 microversion: 2.1 time: 0.221020 Nov 21 13:57:01.928500 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 405/798] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:57:01 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1576 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:57:02.888604 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-67212bb3-4dbd-4517-8097-70bc99249ee7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:02.890239 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-67212bb3-4dbd-4517-8097-70bc99249ee7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:02.897218 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-67212bb3-4dbd-4517-8097-70bc99249ee7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:02.897663 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-67212bb3-4dbd-4517-8097-70bc99249ee7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:02.898637 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-67212bb3-4dbd-4517-8097-70bc99249ee7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:02.899250 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-67212bb3-4dbd-4517-8097-70bc99249ee7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:02.946318 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-f96003ad-e1fc-4801-b83e-bbefad9d905a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:02.947035 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-f96003ad-e1fc-4801-b83e-bbefad9d905a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:02.954544 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f96003ad-e1fc-4801-b83e-bbefad9d905a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:02.955088 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f96003ad-e1fc-4801-b83e-bbefad9d905a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:02.956056 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f96003ad-e1fc-4801-b83e-bbefad9d905a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:02.956569 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f96003ad-e1fc-4801-b83e-bbefad9d905a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:02.983613 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-67212bb3-4dbd-4517-8097-70bc99249ee7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 28358 microversion: 2.1 time: 0.098859 Nov 21 13:57:02.986036 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 394/799] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:57:02 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 28358 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:57:03.125046 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-f96003ad-e1fc-4801-b83e-bbefad9d905a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:03.136233 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-f96003ad-e1fc-4801-b83e-bbefad9d905a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1576 microversion: 2.1 time: 0.195436 Nov 21 13:57:03.148845 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 406/800] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:57:02 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1576 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:57:03.325133 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-b61045dc-59c0-4c14-80f6-7e800a02ce1a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:03.326777 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-b61045dc-59c0-4c14-80f6-7e800a02ce1a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:03.337526 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b61045dc-59c0-4c14-80f6-7e800a02ce1a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:03.338532 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b61045dc-59c0-4c14-80f6-7e800a02ce1a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:03.339573 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b61045dc-59c0-4c14-80f6-7e800a02ce1a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:03.340139 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b61045dc-59c0-4c14-80f6-7e800a02ce1a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:03.373350 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.objects.instance [None req-b61045dc-59c0-4c14-80f6-7e800a02ce1a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lazy-loading 'flavor' on Instance uuid e70a1a57-c34e-418a-b973-e938389a3fa2 {{(pid=122565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:57:03.735547 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-b61045dc-59c0-4c14-80f6-7e800a02ce1a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 202 len: 0 microversion: 2.20 time: 0.414982 Nov 21 13:57:03.736319 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 395/801] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:57:03 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 21 13:57:03.744125 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-25a90334-bd0f-4282-90ac-b94943d0a9c0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:03.744816 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-25a90334-bd0f-4282-90ac-b94943d0a9c0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:03.753629 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-25a90334-bd0f-4282-90ac-b94943d0a9c0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:03.754215 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-25a90334-bd0f-4282-90ac-b94943d0a9c0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:03.755066 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-25a90334-bd0f-4282-90ac-b94943d0a9c0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:03.755566 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-25a90334-bd0f-4282-90ac-b94943d0a9c0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:03.920526 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-25a90334-bd0f-4282-90ac-b94943d0a9c0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:03.930577 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-25a90334-bd0f-4282-90ac-b94943d0a9c0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:03.932044 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-25a90334-bd0f-4282-90ac-b94943d0a9c0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:03.933258 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-25a90334-bd0f-4282-90ac-b94943d0a9c0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1725 microversion: 2.20 time: 0.192814 Nov 21 13:57:03.933861 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 407/802] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:03 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:03.997882 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-83764274-84e7-4105-8eaf-e8d72db84785 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:03.998890 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-83764274-84e7-4105-8eaf-e8d72db84785 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:04.006018 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-83764274-84e7-4105-8eaf-e8d72db84785 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:04.006469 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-83764274-84e7-4105-8eaf-e8d72db84785 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:04.007255 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-83764274-84e7-4105-8eaf-e8d72db84785 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:04.007703 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-83764274-84e7-4105-8eaf-e8d72db84785 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:04.114821 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-83764274-84e7-4105-8eaf-e8d72db84785 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 28522 microversion: 2.1 time: 0.121233 Nov 21 13:57:04.115739 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 396/803] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:57:03 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 28522 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:57:04.154507 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ff0e0c3c-9982-43e9-8baf-8ba4cd7c3c84 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:04.155191 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ff0e0c3c-9982-43e9-8baf-8ba4cd7c3c84 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:04.161214 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ff0e0c3c-9982-43e9-8baf-8ba4cd7c3c84 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:04.161664 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ff0e0c3c-9982-43e9-8baf-8ba4cd7c3c84 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:04.162455 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ff0e0c3c-9982-43e9-8baf-8ba4cd7c3c84 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:04.162894 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ff0e0c3c-9982-43e9-8baf-8ba4cd7c3c84 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:04.310342 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-ff0e0c3c-9982-43e9-8baf-8ba4cd7c3c84 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:04.318662 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ff0e0c3c-9982-43e9-8baf-8ba4cd7c3c84 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1576 microversion: 2.1 time: 0.167866 Nov 21 13:57:04.319235 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 408/804] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:57:04 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:57:04.958354 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-d7bfbf36-b8ef-453b-a648-0f2f9a2cf16d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:04.962607 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-d7bfbf36-b8ef-453b-a648-0f2f9a2cf16d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:04.977503 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d7bfbf36-b8ef-453b-a648-0f2f9a2cf16d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:04.982330 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d7bfbf36-b8ef-453b-a648-0f2f9a2cf16d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:04.983317 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d7bfbf36-b8ef-453b-a648-0f2f9a2cf16d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:04.983774 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d7bfbf36-b8ef-453b-a648-0f2f9a2cf16d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:05.129438 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-58ce4c36-bdbf-403d-a231-4ac372eb479e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:05.133534 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-58ce4c36-bdbf-403d-a231-4ac372eb479e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:05.139943 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-58ce4c36-bdbf-403d-a231-4ac372eb479e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:05.140684 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-58ce4c36-bdbf-403d-a231-4ac372eb479e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:05.141938 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-58ce4c36-bdbf-403d-a231-4ac372eb479e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:05.142641 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-58ce4c36-bdbf-403d-a231-4ac372eb479e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:05.173488 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-d7bfbf36-b8ef-453b-a648-0f2f9a2cf16d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:05.186694 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-d7bfbf36-b8ef-453b-a648-0f2f9a2cf16d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:05.190342 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-d7bfbf36-b8ef-453b-a648-0f2f9a2cf16d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:05.192102 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-d7bfbf36-b8ef-453b-a648-0f2f9a2cf16d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1725 microversion: 2.20 time: 0.242915 Nov 21 13:57:05.200870 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 397/805] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:04 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1725 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:05.252447 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-58ce4c36-bdbf-403d-a231-4ac372eb479e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 28690 microversion: 2.1 time: 0.129517 Nov 21 13:57:05.253597 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 409/806] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:57:05 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 28690 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 13:57:05.336244 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-1e0358eb-833c-4217-beba-de1ca4022165 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:05.337560 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-1e0358eb-833c-4217-beba-de1ca4022165 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:05.348068 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1e0358eb-833c-4217-beba-de1ca4022165 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:05.348519 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1e0358eb-833c-4217-beba-de1ca4022165 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:05.349442 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1e0358eb-833c-4217-beba-de1ca4022165 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:05.349917 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1e0358eb-833c-4217-beba-de1ca4022165 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:05.501915 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-1e0358eb-833c-4217-beba-de1ca4022165 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:05.509749 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-1e0358eb-833c-4217-beba-de1ca4022165 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1563 microversion: 2.1 time: 0.177377 Nov 21 13:57:05.510522 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 398/807] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:57:05 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1563 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:57:06.212490 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-9f72f396-fa6e-46b8-870f-9d385c5e304b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:06.213423 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-9f72f396-fa6e-46b8-870f-9d385c5e304b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:06.221157 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9f72f396-fa6e-46b8-870f-9d385c5e304b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:06.221603 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9f72f396-fa6e-46b8-870f-9d385c5e304b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:06.222391 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9f72f396-fa6e-46b8-870f-9d385c5e304b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:06.222848 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9f72f396-fa6e-46b8-870f-9d385c5e304b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:06.265469 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ba94caf3-39c5-4c6c-8dbd-a2c9e5d86819 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:06.267636 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ba94caf3-39c5-4c6c-8dbd-a2c9e5d86819 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:06.276250 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ba94caf3-39c5-4c6c-8dbd-a2c9e5d86819 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:06.277149 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ba94caf3-39c5-4c6c-8dbd-a2c9e5d86819 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:06.277969 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ba94caf3-39c5-4c6c-8dbd-a2c9e5d86819 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:06.278413 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ba94caf3-39c5-4c6c-8dbd-a2c9e5d86819 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:06.350905 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ba94caf3-39c5-4c6c-8dbd-a2c9e5d86819 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 28690 microversion: 2.1 time: 0.090377 Nov 21 13:57:06.351567 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 399/808] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:57:06 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 28690 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 13:57:06.369218 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-9f72f396-fa6e-46b8-870f-9d385c5e304b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:06.377435 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-9f72f396-fa6e-46b8-870f-9d385c5e304b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:06.378937 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-9f72f396-fa6e-46b8-870f-9d385c5e304b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:06.380121 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-9f72f396-fa6e-46b8-870f-9d385c5e304b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1725 microversion: 2.20 time: 0.173372 Nov 21 13:57:06.390548 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 410/809] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:06 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:07.029185 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-269f0972-39eb-4e3d-b0b0-ef915f96271a req-d5e9ea0c-eb64-48c4-9958-440307b59aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2707c966-28e3-43ba-9241-d5629ba92b06", "name": "network-vif-plugged", "status": "completed", "tag": "5907d47d-9ae0-44a4-adf8-9e5e784f851a"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:07.043624 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:57:07.043624 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:57:07.053822 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-269f0972-39eb-4e3d-b0b0-ef915f96271a req-d5e9ea0c-eb64-48c4-9958-440307b59aee service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:07.054367 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-269f0972-39eb-4e3d-b0b0-ef915f96271a req-d5e9ea0c-eb64-48c4-9958-440307b59aee service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:07.070562 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-269f0972-39eb-4e3d-b0b0-ef915f96271a req-d5e9ea0c-eb64-48c4-9958-440307b59aee service nova] Creating event network-vif-plugged:5907d47d-9ae0-44a4-adf8-9e5e784f851a for instance 2707c966-28e3-43ba-9241-d5629ba92b06 on hv-cinder-76845 Nov 21 13:57:07.075951 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-269f0972-39eb-4e3d-b0b0-ef915f96271a req-d5e9ea0c-eb64-48c4-9958-440307b59aee service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051211 Nov 21 13:57:07.077316 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 400/810] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:57:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:57:07.363426 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-62b604ae-fe81-4ec4-b485-6cbb642f2525 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:07.367690 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-62b604ae-fe81-4ec4-b485-6cbb642f2525 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:07.378234 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-62b604ae-fe81-4ec4-b485-6cbb642f2525 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:07.378894 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-62b604ae-fe81-4ec4-b485-6cbb642f2525 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:07.379463 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-62b604ae-fe81-4ec4-b485-6cbb642f2525 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:07.379987 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-62b604ae-fe81-4ec4-b485-6cbb642f2525 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:07.398563 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-fd8354a6-343c-4408-a05d-ede33dc6d713 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:07.401659 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-fd8354a6-343c-4408-a05d-ede33dc6d713 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:07.408730 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fd8354a6-343c-4408-a05d-ede33dc6d713 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:07.409283 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fd8354a6-343c-4408-a05d-ede33dc6d713 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:07.410177 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fd8354a6-343c-4408-a05d-ede33dc6d713 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:07.410708 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fd8354a6-343c-4408-a05d-ede33dc6d713 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:07.485620 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-62b604ae-fe81-4ec4-b485-6cbb642f2525 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 28690 microversion: 2.1 time: 0.125969 Nov 21 13:57:07.488168 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 411/811] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:57:07 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 28690 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:57:07.559855 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-fd8354a6-343c-4408-a05d-ede33dc6d713 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:07.569702 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-fd8354a6-343c-4408-a05d-ede33dc6d713 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:07.571273 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-fd8354a6-343c-4408-a05d-ede33dc6d713 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:07.572571 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-fd8354a6-343c-4408-a05d-ede33dc6d713 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1725 microversion: 2.20 time: 0.178216 Nov 21 13:57:07.573424 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 401/812] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:07 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 13:57:08.498856 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-add6a367-25dd-49e5-b542-706461be2e10 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:08.500449 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-add6a367-25dd-49e5-b542-706461be2e10 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:08.508133 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-add6a367-25dd-49e5-b542-706461be2e10 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:08.508594 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-add6a367-25dd-49e5-b542-706461be2e10 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:08.509386 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-add6a367-25dd-49e5-b542-706461be2e10 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:08.509881 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-add6a367-25dd-49e5-b542-706461be2e10 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:08.587621 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-add6a367-25dd-49e5-b542-706461be2e10 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 28690 microversion: 2.1 time: 0.092561 Nov 21 13:57:08.589049 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 412/813] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:57:08 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 28690 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:57:08.590742 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-832ad370-5dc3-43ae-88fb-ace7ecba9b5c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:08.592060 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-832ad370-5dc3-43ae-88fb-ace7ecba9b5c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:08.600353 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-832ad370-5dc3-43ae-88fb-ace7ecba9b5c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:08.600809 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-832ad370-5dc3-43ae-88fb-ace7ecba9b5c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:08.601616 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-832ad370-5dc3-43ae-88fb-ace7ecba9b5c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:08.602062 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-832ad370-5dc3-43ae-88fb-ace7ecba9b5c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:08.739720 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-832ad370-5dc3-43ae-88fb-ace7ecba9b5c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:08.747525 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-832ad370-5dc3-43ae-88fb-ace7ecba9b5c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:08.749058 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-832ad370-5dc3-43ae-88fb-ace7ecba9b5c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:08.750481 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-832ad370-5dc3-43ae-88fb-ace7ecba9b5c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1725 microversion: 2.20 time: 0.163725 Nov 21 13:57:08.751057 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 402/814] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:08 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:09.600241 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-d89d7c1a-65c5-4b2b-b63a-fbb7703a3a51 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:09.601134 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-d89d7c1a-65c5-4b2b-b63a-fbb7703a3a51 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:09.608005 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d89d7c1a-65c5-4b2b-b63a-fbb7703a3a51 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:09.608473 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d89d7c1a-65c5-4b2b-b63a-fbb7703a3a51 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:09.609232 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d89d7c1a-65c5-4b2b-b63a-fbb7703a3a51 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:09.609664 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d89d7c1a-65c5-4b2b-b63a-fbb7703a3a51 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:09.676854 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-d89d7c1a-65c5-4b2b-b63a-fbb7703a3a51 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 28690 microversion: 2.1 time: 0.081255 Nov 21 13:57:09.677701 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 413/815] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:57:09 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 28690 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:57:09.769011 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-bb771679-77df-4524-bed5-e0c0911781e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:09.769623 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-bb771679-77df-4524-bed5-e0c0911781e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:09.775976 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bb771679-77df-4524-bed5-e0c0911781e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:09.776471 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bb771679-77df-4524-bed5-e0c0911781e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:09.777253 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bb771679-77df-4524-bed5-e0c0911781e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:09.777700 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bb771679-77df-4524-bed5-e0c0911781e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:09.914487 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bb771679-77df-4524-bed5-e0c0911781e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:09.923540 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bb771679-77df-4524-bed5-e0c0911781e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:09.925245 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bb771679-77df-4524-bed5-e0c0911781e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:09.926415 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-bb771679-77df-4524-bed5-e0c0911781e6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1725 microversion: 2.20 time: 0.161277 Nov 21 13:57:09.926969 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 403/816] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:09 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:10.688741 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-3944d65d-6501-498b-853b-abf475bfe7d7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:10.689759 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3944d65d-6501-498b-853b-abf475bfe7d7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:10.696691 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3944d65d-6501-498b-853b-abf475bfe7d7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:10.697146 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3944d65d-6501-498b-853b-abf475bfe7d7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:10.697932 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3944d65d-6501-498b-853b-abf475bfe7d7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:10.698371 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3944d65d-6501-498b-853b-abf475bfe7d7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:10.794072 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-3944d65d-6501-498b-853b-abf475bfe7d7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 29675 microversion: 2.1 time: 0.109308 Nov 21 13:57:10.798567 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 414/817] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:57:10 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 29675 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:57:10.944314 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c5f8028b-adf7-4afa-a624-6952b8608451 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:10.944840 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-c5f8028b-adf7-4afa-a624-6952b8608451 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:10.951206 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c5f8028b-adf7-4afa-a624-6952b8608451 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:10.951669 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c5f8028b-adf7-4afa-a624-6952b8608451 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:10.952489 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c5f8028b-adf7-4afa-a624-6952b8608451 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:10.952928 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c5f8028b-adf7-4afa-a624-6952b8608451 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:11.084643 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-c5f8028b-adf7-4afa-a624-6952b8608451 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:11.092402 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-c5f8028b-adf7-4afa-a624-6952b8608451 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:11.096429 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-c5f8028b-adf7-4afa-a624-6952b8608451 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:11.096429 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c5f8028b-adf7-4afa-a624-6952b8608451 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1725 microversion: 2.20 time: 0.155585 Nov 21 13:57:11.097353 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 404/818] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:10 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 13:57:11.806822 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-62405648-92b9-40b2-b1b1-35bbe653a721 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:11.807851 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-62405648-92b9-40b2-b1b1-35bbe653a721 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:11.815498 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-62405648-92b9-40b2-b1b1-35bbe653a721 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:11.815980 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-62405648-92b9-40b2-b1b1-35bbe653a721 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:11.816748 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-62405648-92b9-40b2-b1b1-35bbe653a721 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:11.817326 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-62405648-92b9-40b2-b1b1-35bbe653a721 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:11.911345 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-62405648-92b9-40b2-b1b1-35bbe653a721 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 31648 microversion: 2.1 time: 0.108405 Nov 21 13:57:11.912086 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 415/819] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:57:11 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 31648 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:57:12.117399 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-936801e5-b6b3-4227-8605-af5dec2b0be4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:12.117927 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-936801e5-b6b3-4227-8605-af5dec2b0be4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:12.124253 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-936801e5-b6b3-4227-8605-af5dec2b0be4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:12.124964 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-936801e5-b6b3-4227-8605-af5dec2b0be4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:12.126394 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-936801e5-b6b3-4227-8605-af5dec2b0be4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:12.126828 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-936801e5-b6b3-4227-8605-af5dec2b0be4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:12.254879 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-936801e5-b6b3-4227-8605-af5dec2b0be4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:12.262458 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-936801e5-b6b3-4227-8605-af5dec2b0be4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:12.263964 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-936801e5-b6b3-4227-8605-af5dec2b0be4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:12.265097 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-936801e5-b6b3-4227-8605-af5dec2b0be4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1725 microversion: 2.20 time: 0.151464 Nov 21 13:57:12.265650 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 405/820] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:12 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:12.923067 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-a58e5fac-7bf9-4924-a53a-5c3a013d664f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:12.924135 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-a58e5fac-7bf9-4924-a53a-5c3a013d664f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:12.935301 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a58e5fac-7bf9-4924-a53a-5c3a013d664f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:12.936163 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a58e5fac-7bf9-4924-a53a-5c3a013d664f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:12.937115 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a58e5fac-7bf9-4924-a53a-5c3a013d664f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:12.937552 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a58e5fac-7bf9-4924-a53a-5c3a013d664f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:13.019369 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-a58e5fac-7bf9-4924-a53a-5c3a013d664f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 32912 microversion: 2.1 time: 0.100297 Nov 21 13:57:13.020319 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 416/821] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:57:12 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 32912 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:57:13.283147 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-cc8b4fba-21bb-4cf5-8144-6c18492892c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:13.283752 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-cc8b4fba-21bb-4cf5-8144-6c18492892c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:13.290053 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cc8b4fba-21bb-4cf5-8144-6c18492892c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:13.290500 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cc8b4fba-21bb-4cf5-8144-6c18492892c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:13.291274 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cc8b4fba-21bb-4cf5-8144-6c18492892c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:13.291708 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cc8b4fba-21bb-4cf5-8144-6c18492892c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:13.418019 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-cc8b4fba-21bb-4cf5-8144-6c18492892c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:13.426098 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-cc8b4fba-21bb-4cf5-8144-6c18492892c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:13.427577 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-cc8b4fba-21bb-4cf5-8144-6c18492892c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:13.428743 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-cc8b4fba-21bb-4cf5-8144-6c18492892c6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1725 microversion: 2.20 time: 0.149364 Nov 21 13:57:13.429299 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 406/822] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:13 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:14.031010 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-a764d8ec-b2e5-4005-b92c-aff11b1cacde tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:14.032066 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-a764d8ec-b2e5-4005-b92c-aff11b1cacde tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:14.038868 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a764d8ec-b2e5-4005-b92c-aff11b1cacde tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:14.039318 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a764d8ec-b2e5-4005-b92c-aff11b1cacde tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:14.040130 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a764d8ec-b2e5-4005-b92c-aff11b1cacde tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:14.040576 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a764d8ec-b2e5-4005-b92c-aff11b1cacde tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:14.114472 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-a764d8ec-b2e5-4005-b92c-aff11b1cacde tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 33521 microversion: 2.1 time: 0.087375 Nov 21 13:57:14.115095 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 417/823] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:57:14 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 33521 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:57:14.447172 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-fb1b387b-aa2d-4004-aa04-735cb376c286 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:14.447778 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-fb1b387b-aa2d-4004-aa04-735cb376c286 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:14.453971 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fb1b387b-aa2d-4004-aa04-735cb376c286 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:14.454416 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fb1b387b-aa2d-4004-aa04-735cb376c286 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:14.455186 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fb1b387b-aa2d-4004-aa04-735cb376c286 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:14.455620 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fb1b387b-aa2d-4004-aa04-735cb376c286 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:14.581590 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-fb1b387b-aa2d-4004-aa04-735cb376c286 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:14.589203 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-fb1b387b-aa2d-4004-aa04-735cb376c286 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:14.590681 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-fb1b387b-aa2d-4004-aa04-735cb376c286 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:14.592076 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-fb1b387b-aa2d-4004-aa04-735cb376c286 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1725 microversion: 2.20 time: 0.148401 Nov 21 13:57:14.592631 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 407/824] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:14 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:15.127791 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-44b8e9d2-915b-45e8-ad1e-c6e6bc3340ff tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:15.128815 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-44b8e9d2-915b-45e8-ad1e-c6e6bc3340ff tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:15.135561 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-44b8e9d2-915b-45e8-ad1e-c6e6bc3340ff tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:15.136039 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-44b8e9d2-915b-45e8-ad1e-c6e6bc3340ff tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:15.136810 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-44b8e9d2-915b-45e8-ad1e-c6e6bc3340ff tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:15.137244 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-44b8e9d2-915b-45e8-ad1e-c6e6bc3340ff tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:15.218195 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-44b8e9d2-915b-45e8-ad1e-c6e6bc3340ff tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 34351 microversion: 2.1 time: 0.095071 Nov 21 13:57:15.219618 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 418/825] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:57:15 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 34351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:57:15.611353 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ab4f3057-e5fc-4368-bc4a-9469893653e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:15.612111 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ab4f3057-e5fc-4368-bc4a-9469893653e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:15.618404 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ab4f3057-e5fc-4368-bc4a-9469893653e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:15.618855 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ab4f3057-e5fc-4368-bc4a-9469893653e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:15.619629 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ab4f3057-e5fc-4368-bc4a-9469893653e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:15.620099 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ab4f3057-e5fc-4368-bc4a-9469893653e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:15.748311 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ab4f3057-e5fc-4368-bc4a-9469893653e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:15.756224 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ab4f3057-e5fc-4368-bc4a-9469893653e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:15.757731 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ab4f3057-e5fc-4368-bc4a-9469893653e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:15.758884 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ab4f3057-e5fc-4368-bc4a-9469893653e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1725 microversion: 2.20 time: 0.151221 Nov 21 13:57:15.759438 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 408/826] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:15 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:16.231385 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-c8135224-d5e4-4f94-945e-4b06b29df401 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:16.232418 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-c8135224-d5e4-4f94-945e-4b06b29df401 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:16.239292 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c8135224-d5e4-4f94-945e-4b06b29df401 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:16.239749 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c8135224-d5e4-4f94-945e-4b06b29df401 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:16.240562 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c8135224-d5e4-4f94-945e-4b06b29df401 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:16.241004 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c8135224-d5e4-4f94-945e-4b06b29df401 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:16.315021 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-c8135224-d5e4-4f94-945e-4b06b29df401 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 35456 microversion: 2.1 time: 0.087940 Nov 21 13:57:16.315667 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 419/827] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:57:16 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 35456 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:57:16.777595 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a11e5b47-b843-4141-ab99-5a5981389d6c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:16.778200 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a11e5b47-b843-4141-ab99-5a5981389d6c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:16.784482 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a11e5b47-b843-4141-ab99-5a5981389d6c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:16.784929 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a11e5b47-b843-4141-ab99-5a5981389d6c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:16.785698 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a11e5b47-b843-4141-ab99-5a5981389d6c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:16.786127 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a11e5b47-b843-4141-ab99-5a5981389d6c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:16.913034 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a11e5b47-b843-4141-ab99-5a5981389d6c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:16.920617 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a11e5b47-b843-4141-ab99-5a5981389d6c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:16.922121 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a11e5b47-b843-4141-ab99-5a5981389d6c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:16.923264 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a11e5b47-b843-4141-ab99-5a5981389d6c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1725 microversion: 2.20 time: 0.149358 Nov 21 13:57:16.923823 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 409/828] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:16 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:17.326875 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-654aad99-2c79-409d-9254-83bcdf78408c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:17.327902 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-654aad99-2c79-409d-9254-83bcdf78408c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:17.334771 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-654aad99-2c79-409d-9254-83bcdf78408c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:17.335215 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-654aad99-2c79-409d-9254-83bcdf78408c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:17.336009 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-654aad99-2c79-409d-9254-83bcdf78408c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:17.336439 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-654aad99-2c79-409d-9254-83bcdf78408c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:17.429657 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-654aad99-2c79-409d-9254-83bcdf78408c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 36625 microversion: 2.1 time: 0.106638 Nov 21 13:57:17.430278 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 420/829] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:57:17 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 36625 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:57:17.942624 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-48e1e96c-aefd-4693-bc0a-549e8c833133 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:17.943232 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-48e1e96c-aefd-4693-bc0a-549e8c833133 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:17.949433 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-48e1e96c-aefd-4693-bc0a-549e8c833133 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:17.949884 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-48e1e96c-aefd-4693-bc0a-549e8c833133 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:17.950656 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-48e1e96c-aefd-4693-bc0a-549e8c833133 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:17.951090 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-48e1e96c-aefd-4693-bc0a-549e8c833133 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:18.080769 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-48e1e96c-aefd-4693-bc0a-549e8c833133 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:18.088514 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-48e1e96c-aefd-4693-bc0a-549e8c833133 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:18.089999 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-48e1e96c-aefd-4693-bc0a-549e8c833133 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:18.091148 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-48e1e96c-aefd-4693-bc0a-549e8c833133 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1725 microversion: 2.20 time: 0.153869 Nov 21 13:57:18.091706 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 410/830] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:17 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:18.441814 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-864b2d2c-d8e9-4d64-937e-7b950f002047 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:18.442840 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-864b2d2c-d8e9-4d64-937e-7b950f002047 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:18.449626 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-864b2d2c-d8e9-4d64-937e-7b950f002047 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:18.450073 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-864b2d2c-d8e9-4d64-937e-7b950f002047 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:18.450842 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-864b2d2c-d8e9-4d64-937e-7b950f002047 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:18.451271 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-864b2d2c-d8e9-4d64-937e-7b950f002047 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:18.524244 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-864b2d2c-d8e9-4d64-937e-7b950f002047 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 37385 microversion: 2.1 time: 0.086388 Nov 21 13:57:18.524864 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 421/831] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:57:18 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 37385 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 13:57:19.109215 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-964c4e5d-7772-4924-b39d-6084ab855d25 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:19.109820 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-964c4e5d-7772-4924-b39d-6084ab855d25 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:19.116030 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-964c4e5d-7772-4924-b39d-6084ab855d25 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:19.116474 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-964c4e5d-7772-4924-b39d-6084ab855d25 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:19.117274 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-964c4e5d-7772-4924-b39d-6084ab855d25 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:19.117709 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-964c4e5d-7772-4924-b39d-6084ab855d25 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:19.245615 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-964c4e5d-7772-4924-b39d-6084ab855d25 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:19.254567 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-964c4e5d-7772-4924-b39d-6084ab855d25 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:19.255771 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-964c4e5d-7772-4924-b39d-6084ab855d25 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:19.257078 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-964c4e5d-7772-4924-b39d-6084ab855d25 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1725 microversion: 2.20 time: 0.151577 Nov 21 13:57:19.257713 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 411/832] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:19 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:19.535722 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-92443e83-d845-40b1-adaf-33242c4bbfb3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:19.536782 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-92443e83-d845-40b1-adaf-33242c4bbfb3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:19.543516 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-92443e83-d845-40b1-adaf-33242c4bbfb3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:19.544006 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-92443e83-d845-40b1-adaf-33242c4bbfb3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:19.544790 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-92443e83-d845-40b1-adaf-33242c4bbfb3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:19.545227 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-92443e83-d845-40b1-adaf-33242c4bbfb3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:19.628517 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-92443e83-d845-40b1-adaf-33242c4bbfb3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 37884 microversion: 2.1 time: 0.096769 Nov 21 13:57:19.629142 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 422/833] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:57:19 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 37884 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:57:20.275970 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a83c4258-694d-4f3f-8d9a-8c4048dcc736 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:20.276553 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a83c4258-694d-4f3f-8d9a-8c4048dcc736 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:20.282906 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a83c4258-694d-4f3f-8d9a-8c4048dcc736 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:20.283352 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a83c4258-694d-4f3f-8d9a-8c4048dcc736 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:20.284150 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a83c4258-694d-4f3f-8d9a-8c4048dcc736 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:20.284586 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a83c4258-694d-4f3f-8d9a-8c4048dcc736 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:20.413912 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a83c4258-694d-4f3f-8d9a-8c4048dcc736 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:20.421514 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a83c4258-694d-4f3f-8d9a-8c4048dcc736 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:20.423628 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a83c4258-694d-4f3f-8d9a-8c4048dcc736 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:20.424809 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a83c4258-694d-4f3f-8d9a-8c4048dcc736 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1746 microversion: 2.20 time: 0.152547 Nov 21 13:57:20.425357 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 412/834] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:20 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:20.641586 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-5163b576-64c2-46bd-862f-a5cfbeab6175 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:20.642515 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-5163b576-64c2-46bd-862f-a5cfbeab6175 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:20.649421 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5163b576-64c2-46bd-862f-a5cfbeab6175 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:20.649882 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5163b576-64c2-46bd-862f-a5cfbeab6175 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:20.650664 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5163b576-64c2-46bd-862f-a5cfbeab6175 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:20.651101 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5163b576-64c2-46bd-862f-a5cfbeab6175 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:20.751376 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-5163b576-64c2-46bd-862f-a5cfbeab6175 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 38222 microversion: 2.1 time: 0.113867 Nov 21 13:57:20.752038 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 423/835] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:57:20 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 38222 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:57:21.443120 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ffe01102-3919-443a-9ab1-0c277a9bb878 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:21.443713 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ffe01102-3919-443a-9ab1-0c277a9bb878 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:21.449986 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ffe01102-3919-443a-9ab1-0c277a9bb878 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:21.450437 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ffe01102-3919-443a-9ab1-0c277a9bb878 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:21.451215 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ffe01102-3919-443a-9ab1-0c277a9bb878 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:21.451655 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ffe01102-3919-443a-9ab1-0c277a9bb878 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:21.584330 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ffe01102-3919-443a-9ab1-0c277a9bb878 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:21.592027 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ffe01102-3919-443a-9ab1-0c277a9bb878 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:21.593678 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ffe01102-3919-443a-9ab1-0c277a9bb878 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:21.595459 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ffe01102-3919-443a-9ab1-0c277a9bb878 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1746 microversion: 2.20 time: 0.156087 Nov 21 13:57:21.596037 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 413/836] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:21 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:21.763766 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-884123b9-cb6b-4a4d-8b73-0fed0bd788a1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:21.764781 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-884123b9-cb6b-4a4d-8b73-0fed0bd788a1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:21.772329 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-884123b9-cb6b-4a4d-8b73-0fed0bd788a1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:21.772770 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-884123b9-cb6b-4a4d-8b73-0fed0bd788a1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:21.773539 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-884123b9-cb6b-4a4d-8b73-0fed0bd788a1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:21.774086 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-884123b9-cb6b-4a4d-8b73-0fed0bd788a1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:21.845364 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-884123b9-cb6b-4a4d-8b73-0fed0bd788a1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 38222 microversion: 2.1 time: 0.085538 Nov 21 13:57:21.849540 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 424/837] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:57:21 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 38222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:57:22.614157 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-f9e5e94c-2f4d-4845-baf3-62d7199aaa9c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:22.615327 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-f9e5e94c-2f4d-4845-baf3-62d7199aaa9c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:22.623334 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f9e5e94c-2f4d-4845-baf3-62d7199aaa9c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:22.623899 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f9e5e94c-2f4d-4845-baf3-62d7199aaa9c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:22.625831 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f9e5e94c-2f4d-4845-baf3-62d7199aaa9c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:22.626442 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f9e5e94c-2f4d-4845-baf3-62d7199aaa9c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:22.771418 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-f9e5e94c-2f4d-4845-baf3-62d7199aaa9c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:22.779901 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-f9e5e94c-2f4d-4845-baf3-62d7199aaa9c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:22.782344 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-f9e5e94c-2f4d-4845-baf3-62d7199aaa9c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:22.783791 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-f9e5e94c-2f4d-4845-baf3-62d7199aaa9c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1741 microversion: 2.20 time: 0.173948 Nov 21 13:57:22.784767 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 414/838] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:22 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:22.857186 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-6e6af547-a5a5-4e6f-aa06-43a7eadff69f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:22.858105 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-6e6af547-a5a5-4e6f-aa06-43a7eadff69f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:22.867790 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6e6af547-a5a5-4e6f-aa06-43a7eadff69f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:22.868640 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6e6af547-a5a5-4e6f-aa06-43a7eadff69f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:22.870343 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6e6af547-a5a5-4e6f-aa06-43a7eadff69f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:22.871223 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6e6af547-a5a5-4e6f-aa06-43a7eadff69f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:22.956735 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-6e6af547-a5a5-4e6f-aa06-43a7eadff69f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action" status: 200 len: 38353 microversion: 2.1 time: 0.103859 Nov 21 13:57:22.966277 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 425/839] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:57:22 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/action => generated 38353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:57:22.970799 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-5664bea1-c2a9-455d-bea8-09d31584e158 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:22.971289 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-5664bea1-c2a9-455d-bea8-09d31584e158 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:22.980465 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5664bea1-c2a9-455d-bea8-09d31584e158 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:22.981192 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5664bea1-c2a9-455d-bea8-09d31584e158 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:22.982139 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5664bea1-c2a9-455d-bea8-09d31584e158 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:22.982730 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5664bea1-c2a9-455d-bea8-09d31584e158 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:23.012490 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-5664bea1-c2a9-455d-bea8-09d31584e158 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/ips" status: 200 len: 146 microversion: 2.1 time: 0.045467 Nov 21 13:57:23.032148 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 415/840] 10.222.0.11 () {58 vars in 1247 bytes} [Sun Nov 21 13:57:22 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/ips => generated 146 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:57:23.267843 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-b82634ce-6a0a-4c1f-a38a-da4b563aecce req-d3d7d19d-72e0-4882-8fcc-35960014fea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e70a1a57-c34e-418a-b973-e938389a3fa2", "name": "network-vif-plugged", "status": "completed", "tag": "73851145-2483-4c28-bf3b-f049e97c28cc"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:23.269420 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:57:23.269420 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:57:23.277654 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-b82634ce-6a0a-4c1f-a38a-da4b563aecce req-d3d7d19d-72e0-4882-8fcc-35960014fea1 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:23.278593 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-b82634ce-6a0a-4c1f-a38a-da4b563aecce req-d3d7d19d-72e0-4882-8fcc-35960014fea1 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:23.304653 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-b82634ce-6a0a-4c1f-a38a-da4b563aecce req-d3d7d19d-72e0-4882-8fcc-35960014fea1 service nova] Creating event network-vif-plugged:73851145-2483-4c28-bf3b-f049e97c28cc for instance e70a1a57-c34e-418a-b973-e938389a3fa2 on hv-cinder-76845 Nov 21 13:57:23.314963 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-b82634ce-6a0a-4c1f-a38a-da4b563aecce req-d3d7d19d-72e0-4882-8fcc-35960014fea1 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239187 Nov 21 13:57:23.316289 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 426/841] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:57:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:57:23.802210 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-45d89654-2f06-4900-9816-727c9d07dc20 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:23.802821 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-45d89654-2f06-4900-9816-727c9d07dc20 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:23.812964 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-45d89654-2f06-4900-9816-727c9d07dc20 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:23.814090 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-45d89654-2f06-4900-9816-727c9d07dc20 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:23.815192 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-45d89654-2f06-4900-9816-727c9d07dc20 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:23.815638 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-45d89654-2f06-4900-9816-727c9d07dc20 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:23.964230 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-45d89654-2f06-4900-9816-727c9d07dc20 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:23.973635 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-45d89654-2f06-4900-9816-727c9d07dc20 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:23.975193 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-45d89654-2f06-4900-9816-727c9d07dc20 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:23.976402 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-45d89654-2f06-4900-9816-727c9d07dc20 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1741 microversion: 2.20 time: 0.177898 Nov 21 13:57:23.976963 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 416/842] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:23 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:24.445800 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-8a850bb7-4635-42be-971b-09e92571a95e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "501fa34e-4ae4-4036-b7ad-a2d3596be686"}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:24.446942 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-8a850bb7-4635-42be-971b-09e92571a95e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:24.458107 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8a850bb7-4635-42be-971b-09e92571a95e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:24.458552 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8a850bb7-4635-42be-971b-09e92571a95e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:24.459718 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8a850bb7-4635-42be-971b-09e92571a95e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:24.460402 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8a850bb7-4635-42be-971b-09e92571a95e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:24.739902 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-8a850bb7-4635-42be-971b-09e92571a95e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297954 Nov 21 13:57:24.740774 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 427/843] 10.222.0.11 () {60 vars in 1322 bytes} [Sun Nov 21 13:57:24 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:57:24.994277 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-4fc679dd-da54-4ce4-ab5a-b142090a9456 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:24.994873 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-4fc679dd-da54-4ce4-ab5a-b142090a9456 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:25.001512 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4fc679dd-da54-4ce4-ab5a-b142090a9456 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:25.001967 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4fc679dd-da54-4ce4-ab5a-b142090a9456 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:25.002755 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4fc679dd-da54-4ce4-ab5a-b142090a9456 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:25.003183 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4fc679dd-da54-4ce4-ab5a-b142090a9456 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:25.160814 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4fc679dd-da54-4ce4-ab5a-b142090a9456 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:25.172930 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4fc679dd-da54-4ce4-ab5a-b142090a9456 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:25.174548 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4fc679dd-da54-4ce4-ab5a-b142090a9456 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:25.175795 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-4fc679dd-da54-4ce4-ab5a-b142090a9456 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1741 microversion: 2.20 time: 0.185297 Nov 21 13:57:25.176460 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 417/844] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:24 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:26.195317 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-a78b4187-14b5-45e5-937d-65308ec4c5bb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:26.196652 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-a78b4187-14b5-45e5-937d-65308ec4c5bb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:26.203496 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a78b4187-14b5-45e5-937d-65308ec4c5bb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:26.203994 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a78b4187-14b5-45e5-937d-65308ec4c5bb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:26.205051 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a78b4187-14b5-45e5-937d-65308ec4c5bb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:26.205655 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a78b4187-14b5-45e5-937d-65308ec4c5bb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:26.358207 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-a78b4187-14b5-45e5-937d-65308ec4c5bb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:26.369972 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-a78b4187-14b5-45e5-937d-65308ec4c5bb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:26.371898 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-a78b4187-14b5-45e5-937d-65308ec4c5bb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:26.373537 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-a78b4187-14b5-45e5-937d-65308ec4c5bb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1741 microversion: 2.20 time: 0.182483 Nov 21 13:57:26.374759 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 428/845] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:26 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:27.393197 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-7ed87312-d83e-4a01-87bd-2894026e02ef tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:27.393805 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-7ed87312-d83e-4a01-87bd-2894026e02ef tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:27.404795 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7ed87312-d83e-4a01-87bd-2894026e02ef tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:27.405767 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7ed87312-d83e-4a01-87bd-2894026e02ef tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:27.407125 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7ed87312-d83e-4a01-87bd-2894026e02ef tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:27.407878 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7ed87312-d83e-4a01-87bd-2894026e02ef tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:27.566009 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-7ed87312-d83e-4a01-87bd-2894026e02ef tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:27.574444 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-7ed87312-d83e-4a01-87bd-2894026e02ef tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:27.576257 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-7ed87312-d83e-4a01-87bd-2894026e02ef tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:27.577468 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-7ed87312-d83e-4a01-87bd-2894026e02ef tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1741 microversion: 2.20 time: 0.188544 Nov 21 13:57:27.578047 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 418/846] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:27 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:28.596424 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-12e97e50-f146-4e61-b987-e77e21df02a9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:28.597038 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-12e97e50-f146-4e61-b987-e77e21df02a9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:28.603892 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-12e97e50-f146-4e61-b987-e77e21df02a9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:28.604448 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-12e97e50-f146-4e61-b987-e77e21df02a9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:28.605333 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-12e97e50-f146-4e61-b987-e77e21df02a9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:28.605774 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-12e97e50-f146-4e61-b987-e77e21df02a9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:28.746336 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-12e97e50-f146-4e61-b987-e77e21df02a9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:28.755156 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-12e97e50-f146-4e61-b987-e77e21df02a9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:28.756700 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-12e97e50-f146-4e61-b987-e77e21df02a9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:28.757870 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-12e97e50-f146-4e61-b987-e77e21df02a9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1741 microversion: 2.20 time: 0.165970 Nov 21 13:57:28.758428 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 429/847] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:28 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:29.780783 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-3251f610-a40a-447f-b47e-768efc27d0e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:29.781986 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-3251f610-a40a-447f-b47e-768efc27d0e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:29.788847 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3251f610-a40a-447f-b47e-768efc27d0e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:29.789309 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3251f610-a40a-447f-b47e-768efc27d0e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:29.790111 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3251f610-a40a-447f-b47e-768efc27d0e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:29.790554 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3251f610-a40a-447f-b47e-768efc27d0e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:29.939736 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-3251f610-a40a-447f-b47e-768efc27d0e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:29.949488 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-3251f610-a40a-447f-b47e-768efc27d0e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:29.950988 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-3251f610-a40a-447f-b47e-768efc27d0e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:29.952181 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-3251f610-a40a-447f-b47e-768efc27d0e7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1741 microversion: 2.20 time: 0.179134 Nov 21 13:57:29.952746 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 419/848] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:29 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:30.970950 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-4b15c83a-6b8f-4d06-96fd-79f26c040d53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:30.971595 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-4b15c83a-6b8f-4d06-96fd-79f26c040d53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:30.978222 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4b15c83a-6b8f-4d06-96fd-79f26c040d53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:30.978679 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4b15c83a-6b8f-4d06-96fd-79f26c040d53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:30.979522 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4b15c83a-6b8f-4d06-96fd-79f26c040d53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:30.979990 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4b15c83a-6b8f-4d06-96fd-79f26c040d53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:31.128148 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-4b15c83a-6b8f-4d06-96fd-79f26c040d53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:31.138830 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-4b15c83a-6b8f-4d06-96fd-79f26c040d53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:31.140852 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-4b15c83a-6b8f-4d06-96fd-79f26c040d53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:31.142007 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-4b15c83a-6b8f-4d06-96fd-79f26c040d53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1741 microversion: 2.20 time: 0.175374 Nov 21 13:57:31.142565 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 430/849] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:30 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:32.160521 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-bf756f5e-5bac-49e6-83a9-ddfa8d8c8298 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:32.161119 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-bf756f5e-5bac-49e6-83a9-ddfa8d8c8298 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:32.167496 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bf756f5e-5bac-49e6-83a9-ddfa8d8c8298 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:32.167773 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bf756f5e-5bac-49e6-83a9-ddfa8d8c8298 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:32.168551 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bf756f5e-5bac-49e6-83a9-ddfa8d8c8298 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:32.168984 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bf756f5e-5bac-49e6-83a9-ddfa8d8c8298 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:32.275798 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-46022063-b1d6-4fbd-8b6c-e470bd475120 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:32.276810 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-46022063-b1d6-4fbd-8b6c-e470bd475120 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:32.283893 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-46022063-b1d6-4fbd-8b6c-e470bd475120 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:32.284372 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-46022063-b1d6-4fbd-8b6c-e470bd475120 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:32.285910 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-46022063-b1d6-4fbd-8b6c-e470bd475120 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:32.286534 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-46022063-b1d6-4fbd-8b6c-e470bd475120 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:32.306275 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bf756f5e-5bac-49e6-83a9-ddfa8d8c8298 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:32.315198 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bf756f5e-5bac-49e6-83a9-ddfa8d8c8298 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:32.316931 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bf756f5e-5bac-49e6-83a9-ddfa8d8c8298 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:32.318119 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-bf756f5e-5bac-49e6-83a9-ddfa8d8c8298 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1723 microversion: 2.20 time: 0.161246 Nov 21 13:57:32.318843 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 420/850] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:32 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:32.325608 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-46022063-b1d6-4fbd-8b6c-e470bd475120 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054163 Nov 21 13:57:32.326166 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 431/851] 10.222.0.11 () {58 vars in 1301 bytes} [Sun Nov 21 13:57:32 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:57:32.335365 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-4e78e6d4-88ab-449e-bfcb-56295eb58f10 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:32.335884 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-4e78e6d4-88ab-449e-bfcb-56295eb58f10 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:32.341888 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4e78e6d4-88ab-449e-bfcb-56295eb58f10 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:32.342335 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4e78e6d4-88ab-449e-bfcb-56295eb58f10 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:32.343139 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4e78e6d4-88ab-449e-bfcb-56295eb58f10 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:32.343570 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4e78e6d4-88ab-449e-bfcb-56295eb58f10 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:32.371291 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-4e78e6d4-88ab-449e-bfcb-56295eb58f10 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-volume_attachments/501fa34e-4ae4-4036-b7ad-a2d3596be686" status: 200 len: 194 microversion: 2.1 time: 0.039468 Nov 21 13:57:32.371868 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 421/852] 10.222.0.11 () {58 vars in 1412 bytes} [Sun Nov 21 13:57:32 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-volume_attachments/501fa34e-4ae4-4036-b7ad-a2d3596be686 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:57:33.336620 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2b565bed-0757-425c-bd6b-9d8d1ab570d8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:33.337236 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-2b565bed-0757-425c-bd6b-9d8d1ab570d8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:33.343517 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2b565bed-0757-425c-bd6b-9d8d1ab570d8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:33.344535 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2b565bed-0757-425c-bd6b-9d8d1ab570d8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:33.345313 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2b565bed-0757-425c-bd6b-9d8d1ab570d8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:33.345755 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2b565bed-0757-425c-bd6b-9d8d1ab570d8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:33.471782 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-2b565bed-0757-425c-bd6b-9d8d1ab570d8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:33.479441 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-2b565bed-0757-425c-bd6b-9d8d1ab570d8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:33.481021 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-2b565bed-0757-425c-bd6b-9d8d1ab570d8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:33.482178 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-2b565bed-0757-425c-bd6b-9d8d1ab570d8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1723 microversion: 2.20 time: 0.149332 Nov 21 13:57:33.482743 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 432/853] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:33 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:33.665204 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-9bf3a437-d27a-44ae-bcf8-f3a14cd37172 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f8d9ab0-ffb7-441d-95f2-26d368f0a39b"}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:33.666253 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-9bf3a437-d27a-44ae-bcf8-f3a14cd37172 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:33.672509 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9bf3a437-d27a-44ae-bcf8-f3a14cd37172 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:33.672960 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9bf3a437-d27a-44ae-bcf8-f3a14cd37172 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:33.673744 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9bf3a437-d27a-44ae-bcf8-f3a14cd37172 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:33.674183 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9bf3a437-d27a-44ae-bcf8-f3a14cd37172 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:33.900988 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-9bf3a437-d27a-44ae-bcf8-f3a14cd37172 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239442 Nov 21 13:57:33.901604 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 422/854] 10.222.0.11 () {60 vars in 1322 bytes} [Sun Nov 21 13:57:33 2021] POST /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:57:34.500938 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-d211909c-2d17-4c7b-9288-4b71fd9dcbd0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:34.501545 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-d211909c-2d17-4c7b-9288-4b71fd9dcbd0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:34.507764 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d211909c-2d17-4c7b-9288-4b71fd9dcbd0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:34.508250 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d211909c-2d17-4c7b-9288-4b71fd9dcbd0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:34.509032 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d211909c-2d17-4c7b-9288-4b71fd9dcbd0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:34.509466 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d211909c-2d17-4c7b-9288-4b71fd9dcbd0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:34.637470 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-d211909c-2d17-4c7b-9288-4b71fd9dcbd0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:34.645212 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-d211909c-2d17-4c7b-9288-4b71fd9dcbd0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:34.646701 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-d211909c-2d17-4c7b-9288-4b71fd9dcbd0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:34.647868 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-d211909c-2d17-4c7b-9288-4b71fd9dcbd0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1666 microversion: 2.20 time: 0.151436 Nov 21 13:57:34.648418 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 433/855] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:34 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:34.666157 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-cacef33e-05a2-4a1a-aa88-11649ce01298 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02f702d2-dd7c-48ac-949b-5b1c2b5069de"}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:34.667405 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-cacef33e-05a2-4a1a-aa88-11649ce01298 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:34.674461 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cacef33e-05a2-4a1a-aa88-11649ce01298 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:34.674904 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cacef33e-05a2-4a1a-aa88-11649ce01298 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:34.675789 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cacef33e-05a2-4a1a-aa88-11649ce01298 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:34.676247 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cacef33e-05a2-4a1a-aa88-11649ce01298 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:34.924799 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-cacef33e-05a2-4a1a-aa88-11649ce01298 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.262736 Nov 21 13:57:34.925372 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 423/856] 10.222.0.11 () {62 vars in 1363 bytes} [Sun Nov 21 13:57:34 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/os-volume_attachments => generated 188 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 13:57:35.038026 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-75397c37-1104-4036-850a-d301be7e2317 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:35.038520 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-75397c37-1104-4036-850a-d301be7e2317 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:35.044818 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-75397c37-1104-4036-850a-d301be7e2317 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:35.044818 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-75397c37-1104-4036-850a-d301be7e2317 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:35.045488 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-75397c37-1104-4036-850a-d301be7e2317 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:35.046011 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-75397c37-1104-4036-850a-d301be7e2317 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:35.092776 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-2666e480-f54b-4ad5-8131-c5889930ec65 req-2c784e55-1004-4db0-8113-a0a5b51e8653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e70a1a57-c34e-418a-b973-e938389a3fa2", "name": "network-vif-unplugged", "status": "completed", "tag": "73851145-2483-4c28-bf3b-f049e97c28cc"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:35.094318 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:57:35.094318 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:57:35.102949 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-2666e480-f54b-4ad5-8131-c5889930ec65 req-2c784e55-1004-4db0-8113-a0a5b51e8653 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:35.103402 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-2666e480-f54b-4ad5-8131-c5889930ec65 req-2c784e55-1004-4db0-8113-a0a5b51e8653 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:35.115144 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.compute.server_external_events [req-2666e480-f54b-4ad5-8131-c5889930ec65 req-2c784e55-1004-4db0-8113-a0a5b51e8653 service nova] Unable to find a host for instance e70a1a57-c34e-418a-b973-e938389a3fa2. Dropping event network-vif-unplugged {{(pid=122565) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 21 13:57:35.116071 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-2666e480-f54b-4ad5-8131-c5889930ec65 req-2c784e55-1004-4db0-8113-a0a5b51e8653 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027107 Nov 21 13:57:35.116735 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 424/857] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:57:35 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 21 13:57:35.297994 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-75397c37-1104-4036-850a-d301be7e2317 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "DELETE /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/os-volume_attachments/02f702d2-dd7c-48ac-949b-5b1c2b5069de" status: 202 len: 0 microversion: 2.20 time: 0.263692 Nov 21 13:57:35.298599 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 434/858] 10.222.0.11 () {60 vars in 1456 bytes} [Sun Nov 21 13:57:35 2021] DELETE /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/os-volume_attachments/02f702d2-dd7c-48ac-949b-5b1c2b5069de => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 21 13:57:35.350865 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-335b2c6e-e111-4539-a712-022677b3804d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:35.351431 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-335b2c6e-e111-4539-a712-022677b3804d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:35.357197 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-335b2c6e-e111-4539-a712-022677b3804d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:35.357646 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-335b2c6e-e111-4539-a712-022677b3804d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:35.358447 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-335b2c6e-e111-4539-a712-022677b3804d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:35.358864 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-335b2c6e-e111-4539-a712-022677b3804d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:35.433364 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-335b2c6e-e111-4539-a712-022677b3804d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action" status: 202 len: 0 microversion: 2.20 time: 0.086074 Nov 21 13:57:35.434032 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 425/859] 10.222.0.11 () {62 vars in 1318 bytes} [Sun Nov 21 13:57:35 2021] POST /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 21 13:57:35.441969 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-37c2b35b-68bc-4a7a-90dc-ad5d9d5c5463 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:35.442874 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-37c2b35b-68bc-4a7a-90dc-ad5d9d5c5463 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:35.448817 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-37c2b35b-68bc-4a7a-90dc-ad5d9d5c5463 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:35.449263 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-37c2b35b-68bc-4a7a-90dc-ad5d9d5c5463 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:35.450040 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-37c2b35b-68bc-4a7a-90dc-ad5d9d5c5463 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:35.450472 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-37c2b35b-68bc-4a7a-90dc-ad5d9d5c5463 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:35.581931 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-37c2b35b-68bc-4a7a-90dc-ad5d9d5c5463 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:35.589896 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-37c2b35b-68bc-4a7a-90dc-ad5d9d5c5463 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:35.591390 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-37c2b35b-68bc-4a7a-90dc-ad5d9d5c5463 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:35.592574 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-37c2b35b-68bc-4a7a-90dc-ad5d9d5c5463 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1674 microversion: 2.20 time: 0.154519 Nov 21 13:57:35.593132 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 435/860] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:35 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:36.611472 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-d0cea5de-67e5-4b35-928e-f897d94264c5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:36.612112 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-d0cea5de-67e5-4b35-928e-f897d94264c5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:36.618037 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d0cea5de-67e5-4b35-928e-f897d94264c5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:36.618486 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d0cea5de-67e5-4b35-928e-f897d94264c5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:36.619259 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d0cea5de-67e5-4b35-928e-f897d94264c5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:36.619697 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d0cea5de-67e5-4b35-928e-f897d94264c5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:36.802918 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-d0cea5de-67e5-4b35-928e-f897d94264c5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:36.810796 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-d0cea5de-67e5-4b35-928e-f897d94264c5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:36.812984 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-d0cea5de-67e5-4b35-928e-f897d94264c5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:36.814153 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-d0cea5de-67e5-4b35-928e-f897d94264c5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1732 microversion: 2.20 time: 0.207387 Nov 21 13:57:36.814720 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 426/861] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:36 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1732 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:37.833370 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-15cc67e0-cc7a-42e9-bae9-ca1ca501c004 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:37.834748 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-15cc67e0-cc7a-42e9-bae9-ca1ca501c004 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:37.841848 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-15cc67e0-cc7a-42e9-bae9-ca1ca501c004 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:37.842725 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-15cc67e0-cc7a-42e9-bae9-ca1ca501c004 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:37.843883 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-15cc67e0-cc7a-42e9-bae9-ca1ca501c004 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:37.844538 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-15cc67e0-cc7a-42e9-bae9-ca1ca501c004 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:38.007387 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-15cc67e0-cc7a-42e9-bae9-ca1ca501c004 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:38.016030 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-15cc67e0-cc7a-42e9-bae9-ca1ca501c004 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:38.017775 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-15cc67e0-cc7a-42e9-bae9-ca1ca501c004 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:38.018934 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-15cc67e0-cc7a-42e9-bae9-ca1ca501c004 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1732 microversion: 2.20 time: 0.189273 Nov 21 13:57:38.019499 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 436/862] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:37 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:39.037847 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-43d49c79-08aa-4967-b189-1567e61a3dab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:39.038501 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-43d49c79-08aa-4967-b189-1567e61a3dab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:39.045426 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-43d49c79-08aa-4967-b189-1567e61a3dab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:39.045984 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-43d49c79-08aa-4967-b189-1567e61a3dab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:39.047009 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-43d49c79-08aa-4967-b189-1567e61a3dab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:39.047453 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-43d49c79-08aa-4967-b189-1567e61a3dab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:39.194344 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-43d49c79-08aa-4967-b189-1567e61a3dab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:39.202162 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-43d49c79-08aa-4967-b189-1567e61a3dab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:39.204390 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-43d49c79-08aa-4967-b189-1567e61a3dab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:39.205555 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-43d49c79-08aa-4967-b189-1567e61a3dab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1732 microversion: 2.20 time: 0.171791 Nov 21 13:57:39.206128 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 427/863] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:39 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:40.224639 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-84a7b0b5-6096-4c35-b98e-1db0b16ef53a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:40.225317 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-84a7b0b5-6096-4c35-b98e-1db0b16ef53a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:40.231367 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-84a7b0b5-6096-4c35-b98e-1db0b16ef53a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:40.231865 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-84a7b0b5-6096-4c35-b98e-1db0b16ef53a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:40.232657 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-84a7b0b5-6096-4c35-b98e-1db0b16ef53a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:40.233089 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-84a7b0b5-6096-4c35-b98e-1db0b16ef53a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:40.376477 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-84a7b0b5-6096-4c35-b98e-1db0b16ef53a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:40.384457 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-84a7b0b5-6096-4c35-b98e-1db0b16ef53a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:40.386083 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-84a7b0b5-6096-4c35-b98e-1db0b16ef53a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:40.387453 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-84a7b0b5-6096-4c35-b98e-1db0b16ef53a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1732 microversion: 2.20 time: 0.166738 Nov 21 13:57:40.388048 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 437/864] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:40 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:41.406456 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-1d980d04-531a-4895-b31d-0f7bb4543498 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:41.407181 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-1d980d04-531a-4895-b31d-0f7bb4543498 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:41.413666 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1d980d04-531a-4895-b31d-0f7bb4543498 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:41.414223 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1d980d04-531a-4895-b31d-0f7bb4543498 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:41.415100 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1d980d04-531a-4895-b31d-0f7bb4543498 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:41.415615 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1d980d04-531a-4895-b31d-0f7bb4543498 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:41.561441 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-1d980d04-531a-4895-b31d-0f7bb4543498 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:41.569264 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-1d980d04-531a-4895-b31d-0f7bb4543498 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:41.570793 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-1d980d04-531a-4895-b31d-0f7bb4543498 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:41.572008 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-1d980d04-531a-4895-b31d-0f7bb4543498 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1732 microversion: 2.20 time: 0.169959 Nov 21 13:57:41.572568 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 428/865] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:41 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:42.590516 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-07d1e874-7dfb-4eb5-8b19-238a968f8f64 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:42.591110 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-07d1e874-7dfb-4eb5-8b19-238a968f8f64 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:42.597419 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-07d1e874-7dfb-4eb5-8b19-238a968f8f64 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:42.597871 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-07d1e874-7dfb-4eb5-8b19-238a968f8f64 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:42.598649 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-07d1e874-7dfb-4eb5-8b19-238a968f8f64 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:42.599084 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-07d1e874-7dfb-4eb5-8b19-238a968f8f64 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:42.736072 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-07d1e874-7dfb-4eb5-8b19-238a968f8f64 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:42.744324 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-07d1e874-7dfb-4eb5-8b19-238a968f8f64 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:42.745861 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-07d1e874-7dfb-4eb5-8b19-238a968f8f64 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:42.747028 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-07d1e874-7dfb-4eb5-8b19-238a968f8f64 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1732 microversion: 2.20 time: 0.160601 Nov 21 13:57:42.747786 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 438/866] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:42 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:43.018116 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-053ac699-a51f-42ef-ad8f-32a057778fcb tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-858840109"}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:43.018785 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-053ac699-a51f-42ef-ad8f-32a057778fcb tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:43.025061 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-053ac699-a51f-42ef-ad8f-32a057778fcb tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:43.025510 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-053ac699-a51f-42ef-ad8f-32a057778fcb tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:43.026312 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-053ac699-a51f-42ef-ad8f-32a057778fcb tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:43.026744 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-053ac699-a51f-42ef-ad8f-32a057778fcb tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:43.161962 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.network.security_group_api [None req-053ac699-a51f-42ef-ad8f-32a057778fcb tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Removing security group 42126e3d-39be-4ee1-969d-6af11887f875 from port 0f9a92e8-efd7-45cc-b13f-25658f0506ad Nov 21 13:57:43.766022 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-abf7648d-ad84-4ac1-9ef6-519b62737114 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:43.766629 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-abf7648d-ad84-4ac1-9ef6-519b62737114 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:43.772915 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-abf7648d-ad84-4ac1-9ef6-519b62737114 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:43.773366 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-abf7648d-ad84-4ac1-9ef6-519b62737114 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:43.774151 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-abf7648d-ad84-4ac1-9ef6-519b62737114 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:43.774590 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-abf7648d-ad84-4ac1-9ef6-519b62737114 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:43.799896 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-053ac699-a51f-42ef-ad8f-32a057778fcb tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "POST /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/action" status: 202 len: 0 microversion: 2.1 time: 0.786164 Nov 21 13:57:43.803900 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 429/867] 10.222.0.11 () {60 vars in 1277 bytes} [Sun Nov 21 13:57:43 2021] POST /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/action => generated 0 bytes in 791 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:57:43.912398 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-4a35e6ad-229c-4ede-9e77-9c443450c6bf req-54fe2548-518f-430b-98e6-36fb1f2a6b7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b1367a1-8117-4d60-9d06-1a59f6ac647d", "tag": "0f9a92e8-efd7-45cc-b13f-25658f0506ad"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:43.913960 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:57:43.913960 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:57:43.922536 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-4a35e6ad-229c-4ede-9e77-9c443450c6bf req-54fe2548-518f-430b-98e6-36fb1f2a6b7f service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:43.923331 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-4a35e6ad-229c-4ede-9e77-9c443450c6bf req-54fe2548-518f-430b-98e6-36fb1f2a6b7f service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:43.941855 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-4a35e6ad-229c-4ede-9e77-9c443450c6bf req-54fe2548-518f-430b-98e6-36fb1f2a6b7f service nova] Creating event network-changed:0f9a92e8-efd7-45cc-b13f-25658f0506ad for instance 9b1367a1-8117-4d60-9d06-1a59f6ac647d on hv-cinder-76845 Nov 21 13:57:43.950661 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-4a35e6ad-229c-4ede-9e77-9c443450c6bf req-54fe2548-518f-430b-98e6-36fb1f2a6b7f service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137062 Nov 21 13:57:43.955939 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 430/868] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:57:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:57:44.216508 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-abf7648d-ad84-4ac1-9ef6-519b62737114 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:44.227008 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-abf7648d-ad84-4ac1-9ef6-519b62737114 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:44.229055 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-abf7648d-ad84-4ac1-9ef6-519b62737114 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:44.230558 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-abf7648d-ad84-4ac1-9ef6-519b62737114 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1732 microversion: 2.20 time: 0.468336 Nov 21 13:57:44.249969 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 439/869] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:43 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1732 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:45.194314 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-2c013b6a-319f-4c19-964a-f38adca597c4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:45.194915 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-2c013b6a-319f-4c19-964a-f38adca597c4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:45.202137 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2c013b6a-319f-4c19-964a-f38adca597c4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:45.202693 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2c013b6a-319f-4c19-964a-f38adca597c4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:45.203475 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2c013b6a-319f-4c19-964a-f38adca597c4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:45.203950 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2c013b6a-319f-4c19-964a-f38adca597c4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:45.267620 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-91998cad-9739-4309-85ad-330c28d26f53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:45.269553 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-91998cad-9739-4309-85ad-330c28d26f53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:45.279600 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-91998cad-9739-4309-85ad-330c28d26f53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:45.280400 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-91998cad-9739-4309-85ad-330c28d26f53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:45.281950 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-91998cad-9739-4309-85ad-330c28d26f53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:45.282619 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-91998cad-9739-4309-85ad-330c28d26f53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:45.320547 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.objects.instance [None req-2c013b6a-319f-4c19-964a-f38adca597c4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lazy-loading 'services' on Instance uuid 9b1367a1-8117-4d60-9d06-1a59f6ac647d {{(pid=122565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:57:45.413552 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-2c013b6a-319f-4c19-964a-f38adca597c4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "DELETE /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/os-volume_attachments/6961d90f-f3b7-42cf-b099-6a88939fce89" status: 202 len: 0 microversion: 2.1 time: 0.223173 Nov 21 13:57:45.414748 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 431/870] 10.222.0.11 () {58 vars in 1415 bytes} [Sun Nov 21 13:57:45 2021] DELETE /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/os-volume_attachments/6961d90f-f3b7-42cf-b099-6a88939fce89 => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:57:45.424534 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-68610150-a057-4932-a41b-8b2931c199f9 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:45.426156 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-68610150-a057-4932-a41b-8b2931c199f9 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:45.453820 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-68610150-a057-4932-a41b-8b2931c199f9 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:45.454652 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-68610150-a057-4932-a41b-8b2931c199f9 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:45.455750 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-68610150-a057-4932-a41b-8b2931c199f9 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:45.456375 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-68610150-a057-4932-a41b-8b2931c199f9 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:45.534335 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-68610150-a057-4932-a41b-8b2931c199f9 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114760 Nov 21 13:57:45.538316 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 432/871] 10.222.0.11 () {58 vars in 1301 bytes} [Sun Nov 21 13:57:45 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:57:45.574339 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-91998cad-9739-4309-85ad-330c28d26f53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:45.584457 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-91998cad-9739-4309-85ad-330c28d26f53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:45.586575 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-91998cad-9739-4309-85ad-330c28d26f53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:45.587834 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-91998cad-9739-4309-85ad-330c28d26f53 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1732 microversion: 2.20 time: 0.324791 Nov 21 13:57:45.588411 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 440/872] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:45 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1732 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 13:57:45.967295 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-aeb6469c-aa6e-4756-9edd-0ec8d3a95278 req-64cad0dc-ccf3-4e4d-b399-bd66e573f96e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b1367a1-8117-4d60-9d06-1a59f6ac647d", "tag": "0f9a92e8-efd7-45cc-b13f-25658f0506ad"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:45.968989 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:57:45.968989 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:57:45.976139 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-aeb6469c-aa6e-4756-9edd-0ec8d3a95278 req-64cad0dc-ccf3-4e4d-b399-bd66e573f96e service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:45.976594 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-aeb6469c-aa6e-4756-9edd-0ec8d3a95278 req-64cad0dc-ccf3-4e4d-b399-bd66e573f96e service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:45.988250 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-aeb6469c-aa6e-4756-9edd-0ec8d3a95278 req-64cad0dc-ccf3-4e4d-b399-bd66e573f96e service nova] Creating event network-changed:0f9a92e8-efd7-45cc-b13f-25658f0506ad for instance 9b1367a1-8117-4d60-9d06-1a59f6ac647d on hv-cinder-76845 Nov 21 13:57:45.993178 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-aeb6469c-aa6e-4756-9edd-0ec8d3a95278 req-64cad0dc-ccf3-4e4d-b399-bd66e573f96e service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029452 Nov 21 13:57:45.994100 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 433/873] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:57:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:57:46.545614 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-956b5f78-a67b-4d29-972b-05a140acf05b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:46.547045 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-956b5f78-a67b-4d29-972b-05a140acf05b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:46.553317 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-956b5f78-a67b-4d29-972b-05a140acf05b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:46.553770 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-956b5f78-a67b-4d29-972b-05a140acf05b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:46.554551 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-956b5f78-a67b-4d29-972b-05a140acf05b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:46.554986 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-956b5f78-a67b-4d29-972b-05a140acf05b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:46.585386 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-956b5f78-a67b-4d29-972b-05a140acf05b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043444 Nov 21 13:57:46.586077 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 441/874] 10.222.0.11 () {58 vars in 1301 bytes} [Sun Nov 21 13:57:46 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:57:46.607469 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-2621014b-f073-446d-aa4b-cd8e6f46d371 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:46.608274 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-2621014b-f073-446d-aa4b-cd8e6f46d371 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:46.615724 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2621014b-f073-446d-aa4b-cd8e6f46d371 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:46.616220 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2621014b-f073-446d-aa4b-cd8e6f46d371 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:46.617016 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2621014b-f073-446d-aa4b-cd8e6f46d371 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:46.617453 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2621014b-f073-446d-aa4b-cd8e6f46d371 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:46.758132 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2621014b-f073-446d-aa4b-cd8e6f46d371 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:46.766124 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2621014b-f073-446d-aa4b-cd8e6f46d371 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:46.767613 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2621014b-f073-446d-aa4b-cd8e6f46d371 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:46.768800 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-2621014b-f073-446d-aa4b-cd8e6f46d371 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1732 microversion: 2.20 time: 0.165840 Nov 21 13:57:46.769355 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 434/875] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:46 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:47.598506 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-df77adde-8057-4141-bfb7-3a1a65f6a464 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:47.599413 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-df77adde-8057-4141-bfb7-3a1a65f6a464 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:47.605984 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-df77adde-8057-4141-bfb7-3a1a65f6a464 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:47.606431 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-df77adde-8057-4141-bfb7-3a1a65f6a464 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:47.607209 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-df77adde-8057-4141-bfb7-3a1a65f6a464 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:47.607638 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-df77adde-8057-4141-bfb7-3a1a65f6a464 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:47.637496 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-df77adde-8057-4141-bfb7-3a1a65f6a464 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042671 Nov 21 13:57:47.638065 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 442/876] 10.222.0.11 () {58 vars in 1301 bytes} [Sun Nov 21 13:57:47 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:57:47.786382 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-9612ae60-80a0-42d3-a7d9-ee5c08789b11 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:47.787016 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-9612ae60-80a0-42d3-a7d9-ee5c08789b11 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:47.793733 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9612ae60-80a0-42d3-a7d9-ee5c08789b11 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:47.794182 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9612ae60-80a0-42d3-a7d9-ee5c08789b11 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:47.794963 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9612ae60-80a0-42d3-a7d9-ee5c08789b11 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:47.795392 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9612ae60-80a0-42d3-a7d9-ee5c08789b11 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:47.936858 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-9612ae60-80a0-42d3-a7d9-ee5c08789b11 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:47.945848 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-9612ae60-80a0-42d3-a7d9-ee5c08789b11 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:47.947431 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-9612ae60-80a0-42d3-a7d9-ee5c08789b11 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:47.948741 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-9612ae60-80a0-42d3-a7d9-ee5c08789b11 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1732 microversion: 2.20 time: 0.166425 Nov 21 13:57:47.949371 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 435/877] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:47 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:48.649922 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b5674f52-f0d4-43f9-9da1-be424f894649 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:48.650747 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b5674f52-f0d4-43f9-9da1-be424f894649 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:48.657537 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b5674f52-f0d4-43f9-9da1-be424f894649 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:48.657985 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b5674f52-f0d4-43f9-9da1-be424f894649 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:48.658754 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b5674f52-f0d4-43f9-9da1-be424f894649 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:48.659188 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b5674f52-f0d4-43f9-9da1-be424f894649 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:48.687837 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-b5674f52-f0d4-43f9-9da1-be424f894649 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041691 Nov 21 13:57:48.688616 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 443/878] 10.222.0.11 () {58 vars in 1301 bytes} [Sun Nov 21 13:57:48 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:57:48.966276 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ac0c2553-9d18-4d81-a85f-cbc31e9342c7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:48.966890 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ac0c2553-9d18-4d81-a85f-cbc31e9342c7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:48.973182 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ac0c2553-9d18-4d81-a85f-cbc31e9342c7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:48.973636 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ac0c2553-9d18-4d81-a85f-cbc31e9342c7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:48.974419 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ac0c2553-9d18-4d81-a85f-cbc31e9342c7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:48.974861 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ac0c2553-9d18-4d81-a85f-cbc31e9342c7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:49.228001 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ac0c2553-9d18-4d81-a85f-cbc31e9342c7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:49.236129 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ac0c2553-9d18-4d81-a85f-cbc31e9342c7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:49.237674 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ac0c2553-9d18-4d81-a85f-cbc31e9342c7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:49.238841 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ac0c2553-9d18-4d81-a85f-cbc31e9342c7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1732 microversion: 2.20 time: 0.276209 Nov 21 13:57:49.239405 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 436/879] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:48 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1732 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:49.698910 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-1a5483ef-62c2-4e58-9eb4-1d99dbd7eed7 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:49.699910 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-1a5483ef-62c2-4e58-9eb4-1d99dbd7eed7 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:49.705886 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1a5483ef-62c2-4e58-9eb4-1d99dbd7eed7 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:49.706332 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1a5483ef-62c2-4e58-9eb4-1d99dbd7eed7 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:49.707116 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1a5483ef-62c2-4e58-9eb4-1d99dbd7eed7 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:49.707567 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1a5483ef-62c2-4e58-9eb4-1d99dbd7eed7 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:49.738127 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-1a5483ef-62c2-4e58-9eb4-1d99dbd7eed7 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042752 Nov 21 13:57:49.738625 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 444/880] 10.222.0.11 () {58 vars in 1301 bytes} [Sun Nov 21 13:57:49 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:57:50.004147 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-5f26e806-2449-4777-9e26-3ff7fc66d3a8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:50.005162 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-5f26e806-2449-4777-9e26-3ff7fc66d3a8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:50.011525 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5f26e806-2449-4777-9e26-3ff7fc66d3a8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:50.012023 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5f26e806-2449-4777-9e26-3ff7fc66d3a8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:50.012810 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5f26e806-2449-4777-9e26-3ff7fc66d3a8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:50.013252 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5f26e806-2449-4777-9e26-3ff7fc66d3a8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:50.042661 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-5f26e806-2449-4777-9e26-3ff7fc66d3a8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042393 Nov 21 13:57:50.043216 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 437/881] 10.222.0.11 () {58 vars in 1301 bytes} [Sun Nov 21 13:57:49 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:57:50.257859 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-4ee311a9-1644-46eb-80a1-133ca8824d63 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:50.258384 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-4ee311a9-1644-46eb-80a1-133ca8824d63 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:50.264288 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4ee311a9-1644-46eb-80a1-133ca8824d63 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:50.264740 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4ee311a9-1644-46eb-80a1-133ca8824d63 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:50.266030 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4ee311a9-1644-46eb-80a1-133ca8824d63 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:50.266472 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4ee311a9-1644-46eb-80a1-133ca8824d63 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:50.314604 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-aadf09c9-6f04-4d4e-9c39-9073bd4d2385 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:50.315272 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-aadf09c9-6f04-4d4e-9c39-9073bd4d2385 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:50.321606 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-aadf09c9-6f04-4d4e-9c39-9073bd4d2385 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:50.322288 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-aadf09c9-6f04-4d4e-9c39-9073bd4d2385 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:50.323141 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-aadf09c9-6f04-4d4e-9c39-9073bd4d2385 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:50.323650 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-aadf09c9-6f04-4d4e-9c39-9073bd4d2385 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:50.356188 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-aadf09c9-6f04-4d4e-9c39-9073bd4d2385 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-volume_attachments/501fa34e-4ae4-4036-b7ad-a2d3596be686" status: 200 len: 194 microversion: 2.1 time: 0.045214 Nov 21 13:57:50.356785 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 438/882] 10.222.0.11 () {58 vars in 1412 bytes} [Sun Nov 21 13:57:50 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-volume_attachments/501fa34e-4ae4-4036-b7ad-a2d3596be686 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:57:50.365801 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ccbdceb8-d1be-4679-a6e3-a39c5f5b7086 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:50.366289 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ccbdceb8-d1be-4679-a6e3-a39c5f5b7086 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:50.372024 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ccbdceb8-d1be-4679-a6e3-a39c5f5b7086 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:50.372477 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ccbdceb8-d1be-4679-a6e3-a39c5f5b7086 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:50.373254 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ccbdceb8-d1be-4679-a6e3-a39c5f5b7086 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:50.373691 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ccbdceb8-d1be-4679-a6e3-a39c5f5b7086 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:50.400582 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-4ee311a9-1644-46eb-80a1-133ca8824d63 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:50.409149 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-4ee311a9-1644-46eb-80a1-133ca8824d63 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:50.410658 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-4ee311a9-1644-46eb-80a1-133ca8824d63 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:50.411923 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-4ee311a9-1644-46eb-80a1-133ca8824d63 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1732 microversion: 2.20 time: 0.157803 Nov 21 13:57:50.412485 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 445/883] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:50 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:50.451192 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.objects.instance [None req-ccbdceb8-d1be-4679-a6e3-a39c5f5b7086 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lazy-loading 'services' on Instance uuid fe7c81c3-cb32-476d-97c8-9a0d8d19f156 {{(pid=122565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:57:50.518851 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ccbdceb8-d1be-4679-a6e3-a39c5f5b7086 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "DELETE /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-volume_attachments/501fa34e-4ae4-4036-b7ad-a2d3596be686" status: 202 len: 0 microversion: 2.1 time: 0.156455 Nov 21 13:57:50.519431 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 439/884] 10.222.0.11 () {58 vars in 1415 bytes} [Sun Nov 21 13:57:50 2021] DELETE /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-volume_attachments/501fa34e-4ae4-4036-b7ad-a2d3596be686 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:57:50.750116 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-7b565a17-488f-46d5-a04c-c4e45a2ffb8a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:50.751026 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-7b565a17-488f-46d5-a04c-c4e45a2ffb8a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:50.757322 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7b565a17-488f-46d5-a04c-c4e45a2ffb8a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:50.757774 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7b565a17-488f-46d5-a04c-c4e45a2ffb8a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:50.758556 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7b565a17-488f-46d5-a04c-c4e45a2ffb8a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:50.758996 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7b565a17-488f-46d5-a04c-c4e45a2ffb8a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:50.788454 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-7b565a17-488f-46d5-a04c-c4e45a2ffb8a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042844 Nov 21 13:57:50.789019 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 446/885] 10.222.0.11 () {58 vars in 1301 bytes} [Sun Nov 21 13:57:50 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:57:50.799489 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-417641b7-30d7-4da0-8fb0-819e3b488741 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:50.800118 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-417641b7-30d7-4da0-8fb0-819e3b488741 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:50.806219 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-417641b7-30d7-4da0-8fb0-819e3b488741 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:50.806668 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-417641b7-30d7-4da0-8fb0-819e3b488741 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:50.807452 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-417641b7-30d7-4da0-8fb0-819e3b488741 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:50.807926 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-417641b7-30d7-4da0-8fb0-819e3b488741 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:50.880066 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-417641b7-30d7-4da0-8fb0-819e3b488741 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] HTTP exception thrown: Instance 9b1367a1-8117-4d60-9d06-1a59f6ac647d is not attached to volume 6961d90f-f3b7-42cf-b099-6a88939fce89 Nov 21 13:57:50.880669 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-417641b7-30d7-4da0-8fb0-819e3b488741 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Returning 404 to user: Instance 9b1367a1-8117-4d60-9d06-1a59f6ac647d is not attached to volume 6961d90f-f3b7-42cf-b099-6a88939fce89 {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:57:50.881505 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-417641b7-30d7-4da0-8fb0-819e3b488741 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "DELETE /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/os-volume_attachments/6961d90f-f3b7-42cf-b099-6a88939fce89" status: 404 len: 154 microversion: 2.1 time: 0.086660 Nov 21 13:57:50.882050 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 440/886] 10.222.0.11 () {58 vars in 1415 bytes} [Sun Nov 21 13:57:50 2021] DELETE /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d/os-volume_attachments/6961d90f-f3b7-42cf-b099-6a88939fce89 => generated 154 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:57:51.429275 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ee865ce2-719f-4d1a-93bf-a2d62e3ee650 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:51.429880 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ee865ce2-719f-4d1a-93bf-a2d62e3ee650 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:51.436309 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ee865ce2-719f-4d1a-93bf-a2d62e3ee650 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:51.436778 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ee865ce2-719f-4d1a-93bf-a2d62e3ee650 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:51.437552 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ee865ce2-719f-4d1a-93bf-a2d62e3ee650 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:51.437987 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ee865ce2-719f-4d1a-93bf-a2d62e3ee650 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:51.576282 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-ee865ce2-719f-4d1a-93bf-a2d62e3ee650 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:51.587229 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-ee865ce2-719f-4d1a-93bf-a2d62e3ee650 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:51.588779 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-ee865ce2-719f-4d1a-93bf-a2d62e3ee650 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:51.590376 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ee865ce2-719f-4d1a-93bf-a2d62e3ee650 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1732 microversion: 2.20 time: 0.164474 Nov 21 13:57:51.590933 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 447/887] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:51 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:51.634357 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-74ddb1f6-208e-4ca7-9d43-7378eb735dc4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:51.634884 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-74ddb1f6-208e-4ca7-9d43-7378eb735dc4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:51.641758 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-74ddb1f6-208e-4ca7-9d43-7378eb735dc4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:51.642216 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-74ddb1f6-208e-4ca7-9d43-7378eb735dc4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:51.643001 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-74ddb1f6-208e-4ca7-9d43-7378eb735dc4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:51.643438 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-74ddb1f6-208e-4ca7-9d43-7378eb735dc4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:51.673150 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-74ddb1f6-208e-4ca7-9d43-7378eb735dc4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-volume_attachments/9f8d9ab0-ffb7-441d-95f2-26d368f0a39b" status: 200 len: 194 microversion: 2.1 time: 0.042531 Nov 21 13:57:51.674001 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 441/888] 10.222.0.11 () {58 vars in 1412 bytes} [Sun Nov 21 13:57:51 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-volume_attachments/9f8d9ab0-ffb7-441d-95f2-26d368f0a39b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:57:51.683347 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2c2beedf-4910-4b3c-8151-e53d74b7e893 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:51.683860 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-2c2beedf-4910-4b3c-8151-e53d74b7e893 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:51.689590 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2c2beedf-4910-4b3c-8151-e53d74b7e893 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:51.690035 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2c2beedf-4910-4b3c-8151-e53d74b7e893 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:51.690810 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2c2beedf-4910-4b3c-8151-e53d74b7e893 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:51.691244 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2c2beedf-4910-4b3c-8151-e53d74b7e893 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:51.769800 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.objects.instance [None req-2c2beedf-4910-4b3c-8151-e53d74b7e893 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lazy-loading 'services' on Instance uuid fe7c81c3-cb32-476d-97c8-9a0d8d19f156 {{(pid=122564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:57:51.835676 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-2c2beedf-4910-4b3c-8151-e53d74b7e893 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "DELETE /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-volume_attachments/9f8d9ab0-ffb7-441d-95f2-26d368f0a39b" status: 202 len: 0 microversion: 2.1 time: 0.155751 Nov 21 13:57:51.836286 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 448/889] 10.222.0.11 () {58 vars in 1415 bytes} [Sun Nov 21 13:57:51 2021] DELETE /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-volume_attachments/9f8d9ab0-ffb7-441d-95f2-26d368f0a39b => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:57:52.007037 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-12e79d4f-1a58-43e7-967d-ec2e612b110b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:52.007549 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-12e79d4f-1a58-43e7-967d-ec2e612b110b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:52.013308 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-12e79d4f-1a58-43e7-967d-ec2e612b110b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:52.013766 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-12e79d4f-1a58-43e7-967d-ec2e612b110b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:52.014582 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-12e79d4f-1a58-43e7-967d-ec2e612b110b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:52.015644 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-12e79d4f-1a58-43e7-967d-ec2e612b110b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:52.038415 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-12e79d4f-1a58-43e7-967d-ec2e612b110b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Going to try to terminate instance {{(pid=122565) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 21 13:57:52.109320 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-12e79d4f-1a58-43e7-967d-ec2e612b110b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "DELETE /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 204 len: 0 microversion: 2.1 time: 0.105373 Nov 21 13:57:52.109790 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 442/890] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 13:57:52 2021] DELETE /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 13:57:52.118918 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-382c03aa-4524-4d54-93d6-262053f99c55 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:52.119646 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-382c03aa-4524-4d54-93d6-262053f99c55 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:52.126497 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-382c03aa-4524-4d54-93d6-262053f99c55 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:52.126972 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-382c03aa-4524-4d54-93d6-262053f99c55 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:52.127743 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-382c03aa-4524-4d54-93d6-262053f99c55 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:52.128198 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-382c03aa-4524-4d54-93d6-262053f99c55 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:52.255564 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-382c03aa-4524-4d54-93d6-262053f99c55 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:52.262858 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-382c03aa-4524-4d54-93d6-262053f99c55 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1553 microversion: 2.1 time: 0.148169 Nov 21 13:57:52.263427 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 449/891] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:57:52 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:57:52.610348 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-cc7e869d-c713-4fee-ab16-a1c91f96ba0c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:52.611043 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-cc7e869d-c713-4fee-ab16-a1c91f96ba0c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:52.617267 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cc7e869d-c713-4fee-ab16-a1c91f96ba0c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:52.617661 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cc7e869d-c713-4fee-ab16-a1c91f96ba0c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:52.618442 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cc7e869d-c713-4fee-ab16-a1c91f96ba0c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:52.618877 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cc7e869d-c713-4fee-ab16-a1c91f96ba0c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:52.750050 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-cc7e869d-c713-4fee-ab16-a1c91f96ba0c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:52.757906 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-cc7e869d-c713-4fee-ab16-a1c91f96ba0c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:52.759404 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-cc7e869d-c713-4fee-ab16-a1c91f96ba0c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:52.760583 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-cc7e869d-c713-4fee-ab16-a1c91f96ba0c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1732 microversion: 2.20 time: 0.154883 Nov 21 13:57:52.761134 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 443/892] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:52 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:52.984722 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-48171223-8d5a-409e-97d8-55603ee57790 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:52.985740 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-48171223-8d5a-409e-97d8-55603ee57790 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:52.992193 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-48171223-8d5a-409e-97d8-55603ee57790 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:52.992640 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-48171223-8d5a-409e-97d8-55603ee57790 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:52.993411 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-48171223-8d5a-409e-97d8-55603ee57790 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:52.993843 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-48171223-8d5a-409e-97d8-55603ee57790 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:53.022193 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-48171223-8d5a-409e-97d8-55603ee57790 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041793 Nov 21 13:57:53.022735 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 450/893] 10.222.0.11 () {58 vars in 1301 bytes} [Sun Nov 21 13:57:52 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:57:53.120049 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-f4c176e7-a717-4bb9-b23a-18804213f2ee tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:53.120922 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-f4c176e7-a717-4bb9-b23a-18804213f2ee tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:53.127006 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f4c176e7-a717-4bb9-b23a-18804213f2ee tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:53.127458 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f4c176e7-a717-4bb9-b23a-18804213f2ee tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:53.128271 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f4c176e7-a717-4bb9-b23a-18804213f2ee tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:53.128711 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f4c176e7-a717-4bb9-b23a-18804213f2ee tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:53.157469 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-f4c176e7-a717-4bb9-b23a-18804213f2ee tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041089 Nov 21 13:57:53.157945 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 444/894] 10.222.0.11 () {58 vars in 1301 bytes} [Sun Nov 21 13:57:53 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:57:53.211596 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-f3ffe78f-d553-4571-b93f-082357099b61 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:53.212211 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-f3ffe78f-d553-4571-b93f-082357099b61 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:53.217971 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f3ffe78f-d553-4571-b93f-082357099b61 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:53.219027 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f3ffe78f-d553-4571-b93f-082357099b61 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:53.219831 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f3ffe78f-d553-4571-b93f-082357099b61 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:53.220283 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f3ffe78f-d553-4571-b93f-082357099b61 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:53.230561 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-a4907e29-f56e-444d-bd1e-9f68c05f3cc7 req-b51b39ad-3209-4d70-b686-1754b2a75bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e70a1a57-c34e-418a-b973-e938389a3fa2", "name": "network-vif-plugged", "status": "completed", "tag": "73851145-2483-4c28-bf3b-f049e97c28cc"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:53.233665 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:57:53.233665 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:57:53.241534 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-a4907e29-f56e-444d-bd1e-9f68c05f3cc7 req-b51b39ad-3209-4d70-b686-1754b2a75bcd service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:53.242058 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-a4907e29-f56e-444d-bd1e-9f68c05f3cc7 req-b51b39ad-3209-4d70-b686-1754b2a75bcd service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:53.245706 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-f3ffe78f-d553-4571-b93f-082357099b61 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Going to try to terminate instance {{(pid=122564) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 21 13:57:53.255377 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-a4907e29-f56e-444d-bd1e-9f68c05f3cc7 req-b51b39ad-3209-4d70-b686-1754b2a75bcd service nova] Creating event network-vif-plugged:73851145-2483-4c28-bf3b-f049e97c28cc for instance e70a1a57-c34e-418a-b973-e938389a3fa2 on hv-cinder-76845 Nov 21 13:57:53.260361 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-a4907e29-f56e-444d-bd1e-9f68c05f3cc7 req-b51b39ad-3209-4d70-b686-1754b2a75bcd service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033298 Nov 21 13:57:53.261441 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 445/895] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:57:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:57:53.282252 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-151b3e45-6c25-4783-8b6b-8a28a6daa51d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:53.283418 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-151b3e45-6c25-4783-8b6b-8a28a6daa51d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:53.291090 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-151b3e45-6c25-4783-8b6b-8a28a6daa51d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:53.291090 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-151b3e45-6c25-4783-8b6b-8a28a6daa51d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:53.291846 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-151b3e45-6c25-4783-8b6b-8a28a6daa51d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:53.292293 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-151b3e45-6c25-4783-8b6b-8a28a6daa51d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:53.353961 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-f3ffe78f-d553-4571-b93f-082357099b61 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "DELETE /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156" status: 204 len: 0 microversion: 2.1 time: 0.145620 Nov 21 13:57:53.355032 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 451/896] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 13:57:53 2021] DELETE /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 13:57:53.363259 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-caf155ea-d9d4-45f5-87f3-c485e6d6c4e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:53.364271 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-caf155ea-d9d4-45f5-87f3-c485e6d6c4e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:53.371621 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-caf155ea-d9d4-45f5-87f3-c485e6d6c4e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:53.372176 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-caf155ea-d9d4-45f5-87f3-c485e6d6c4e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:53.372989 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-caf155ea-d9d4-45f5-87f3-c485e6d6c4e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:53.373498 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-caf155ea-d9d4-45f5-87f3-c485e6d6c4e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:53.449570 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-151b3e45-6c25-4783-8b6b-8a28a6daa51d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:53.457902 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-151b3e45-6c25-4783-8b6b-8a28a6daa51d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1553 microversion: 2.1 time: 0.180602 Nov 21 13:57:53.458481 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 446/897] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:57:53 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:57:53.518281 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-caf155ea-d9d4-45f5-87f3-c485e6d6c4e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:53.525654 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-caf155ea-d9d4-45f5-87f3-c485e6d6c4e7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156" status: 200 len: 1675 microversion: 2.1 time: 0.166390 Nov 21 13:57:53.526232 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 452/898] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:57:53 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:57:53.778352 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-2c1a7728-dcda-499b-b7ab-509da0bccbac tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:53.778958 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-2c1a7728-dcda-499b-b7ab-509da0bccbac tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:53.785914 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2c1a7728-dcda-499b-b7ab-509da0bccbac tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:53.786369 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2c1a7728-dcda-499b-b7ab-509da0bccbac tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:53.787153 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2c1a7728-dcda-499b-b7ab-509da0bccbac tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:53.787591 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2c1a7728-dcda-499b-b7ab-509da0bccbac tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:53.942436 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2c1a7728-dcda-499b-b7ab-509da0bccbac tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:53.950230 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2c1a7728-dcda-499b-b7ab-509da0bccbac tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:53.951729 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2c1a7728-dcda-499b-b7ab-509da0bccbac tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:53.953464 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-2c1a7728-dcda-499b-b7ab-509da0bccbac tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1732 microversion: 2.20 time: 0.178821 Nov 21 13:57:53.954254 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 447/899] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:53 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:54.474260 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-aebfaffb-d1e0-49c4-916b-910e0bc0e188 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:54.474875 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-aebfaffb-d1e0-49c4-916b-910e0bc0e188 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:54.481345 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-aebfaffb-d1e0-49c4-916b-910e0bc0e188 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:54.481797 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-aebfaffb-d1e0-49c4-916b-910e0bc0e188 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:54.482587 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-aebfaffb-d1e0-49c4-916b-910e0bc0e188 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:54.483029 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-aebfaffb-d1e0-49c4-916b-910e0bc0e188 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:54.542504 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-f1f6c496-92f6-43be-81b0-cc3508eae91a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:54.543221 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-f1f6c496-92f6-43be-81b0-cc3508eae91a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:54.549849 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f1f6c496-92f6-43be-81b0-cc3508eae91a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:54.550302 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f1f6c496-92f6-43be-81b0-cc3508eae91a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:54.551244 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f1f6c496-92f6-43be-81b0-cc3508eae91a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:54.551694 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f1f6c496-92f6-43be-81b0-cc3508eae91a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:54.815729 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-f1f6c496-92f6-43be-81b0-cc3508eae91a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:54.826435 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-f1f6c496-92f6-43be-81b0-cc3508eae91a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156" status: 200 len: 1675 microversion: 2.1 time: 0.287711 Nov 21 13:57:54.828376 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 448/900] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:57:54 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156 => generated 1675 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:57:54.847227 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-aebfaffb-d1e0-49c4-916b-910e0bc0e188 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26909ec566cc4b59b271cb089f0078a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406bef8592334a749f671da6881b0cf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:54.854885 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-aebfaffb-d1e0-49c4-916b-910e0bc0e188 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 200 len: 1553 microversion: 2.1 time: 0.384213 Nov 21 13:57:54.855843 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 453/901] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:57:54 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 1553 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:57:54.972048 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-25b7ae05-c60d-4fad-9562-211483ac9bc0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:54.974709 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-25b7ae05-c60d-4fad-9562-211483ac9bc0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:54.981088 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-25b7ae05-c60d-4fad-9562-211483ac9bc0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:54.981836 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-25b7ae05-c60d-4fad-9562-211483ac9bc0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:54.983395 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-25b7ae05-c60d-4fad-9562-211483ac9bc0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:54.984502 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-25b7ae05-c60d-4fad-9562-211483ac9bc0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:55.002621 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-309484c0-578a-4421-9b39-0604597e90a8 req-b842157f-ac21-448c-8a9c-36306baedeba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b1367a1-8117-4d60-9d06-1a59f6ac647d", "name": "network-vif-deleted", "tag": "0f9a92e8-efd7-45cc-b13f-25658f0506ad"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:55.004355 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:57:55.004355 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:57:55.015284 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-309484c0-578a-4421-9b39-0604597e90a8 req-b842157f-ac21-448c-8a9c-36306baedeba service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:55.015706 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-309484c0-578a-4421-9b39-0604597e90a8 req-b842157f-ac21-448c-8a9c-36306baedeba service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:55.029397 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-309484c0-578a-4421-9b39-0604597e90a8 req-b842157f-ac21-448c-8a9c-36306baedeba service nova] Creating event network-vif-deleted:0f9a92e8-efd7-45cc-b13f-25658f0506ad for instance 9b1367a1-8117-4d60-9d06-1a59f6ac647d on hv-cinder-76845 Nov 21 13:57:55.035062 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-309484c0-578a-4421-9b39-0604597e90a8 req-b842157f-ac21-448c-8a9c-36306baedeba service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037790 Nov 21 13:57:55.036019 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 454/902] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:57:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:57:55.161418 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-25b7ae05-c60d-4fad-9562-211483ac9bc0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:55.169491 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-25b7ae05-c60d-4fad-9562-211483ac9bc0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:55.171001 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-25b7ae05-c60d-4fad-9562-211483ac9bc0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:55.172745 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-25b7ae05-c60d-4fad-9562-211483ac9bc0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1732 microversion: 2.20 time: 0.205139 Nov 21 13:57:55.173540 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 449/903] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:54 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1732 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:55.844709 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-88f893ef-ff0a-4c0b-afd4-3a467efca421 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:55.845321 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-88f893ef-ff0a-4c0b-afd4-3a467efca421 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:55.851781 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-88f893ef-ff0a-4c0b-afd4-3a467efca421 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:55.852269 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-88f893ef-ff0a-4c0b-afd4-3a467efca421 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:55.853058 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-88f893ef-ff0a-4c0b-afd4-3a467efca421 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:55.853498 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-88f893ef-ff0a-4c0b-afd4-3a467efca421 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:55.872234 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c019236a-928a-4124-bda5-25ba5216f63e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:55.872990 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-c019236a-928a-4124-bda5-25ba5216f63e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] [instance: 9b1367a1-8117-4d60-9d06-1a59f6ac647d] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:55.880149 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c019236a-928a-4124-bda5-25ba5216f63e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:55.880710 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c019236a-928a-4124-bda5-25ba5216f63e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:55.881601 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c019236a-928a-4124-bda5-25ba5216f63e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:55.882129 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c019236a-928a-4124-bda5-25ba5216f63e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:55.898452 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-c019236a-928a-4124-bda5-25ba5216f63e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] HTTP exception thrown: Instance 9b1367a1-8117-4d60-9d06-1a59f6ac647d could not be found. Nov 21 13:57:55.899053 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c019236a-928a-4124-bda5-25ba5216f63e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Returning 404 to user: Instance 9b1367a1-8117-4d60-9d06-1a59f6ac647d could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:57:55.899903 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c019236a-928a-4124-bda5-25ba5216f63e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d" status: 404 len: 111 microversion: 2.1 time: 0.031308 Nov 21 13:57:55.900822 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 450/904] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:57:55 2021] GET /compute/v2.1/servers/9b1367a1-8117-4d60-9d06-1a59f6ac647d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 21 13:57:55.908381 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-6d032118-5ae4-475c-b0db-0451fdd20162 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling method '.version_select at 0x7fd513491e50>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:55.926197 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-6d032118-5ae4-475c-b0db-0451fdd20162 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-146073214" status: 202 len: 0 microversion: 2.1 time: 0.021220 Nov 21 13:57:55.930016 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 451/905] 10.222.0.11 () {58 vars in 1268 bytes} [Sun Nov 21 13:57:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-146073214 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:57:55.992475 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-88f893ef-ff0a-4c0b-afd4-3a467efca421 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:56.001912 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-88f893ef-ff0a-4c0b-afd4-3a467efca421 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156" status: 200 len: 1675 microversion: 2.1 time: 0.161241 Nov 21 13:57:56.011485 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 455/906] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:57:55 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:57:56.191872 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a2fadb42-5119-4d42-80a0-c6cdf6d5cbe7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:56.192492 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a2fadb42-5119-4d42-80a0-c6cdf6d5cbe7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:56.198806 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a2fadb42-5119-4d42-80a0-c6cdf6d5cbe7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:56.199241 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a2fadb42-5119-4d42-80a0-c6cdf6d5cbe7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:56.200562 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a2fadb42-5119-4d42-80a0-c6cdf6d5cbe7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:56.201199 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a2fadb42-5119-4d42-80a0-c6cdf6d5cbe7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:56.435096 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a2fadb42-5119-4d42-80a0-c6cdf6d5cbe7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:56.443407 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a2fadb42-5119-4d42-80a0-c6cdf6d5cbe7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:56.444935 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a2fadb42-5119-4d42-80a0-c6cdf6d5cbe7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:56.446288 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a2fadb42-5119-4d42-80a0-c6cdf6d5cbe7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1719 microversion: 2.20 time: 0.259776 Nov 21 13:57:56.447195 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 452/907] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:57:56 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1719 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:57:57.018800 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-068ce943-9107-4253-96c1-b30cb74e74af tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:57.019426 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-068ce943-9107-4253-96c1-b30cb74e74af tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:57.025704 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-068ce943-9107-4253-96c1-b30cb74e74af tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:57.026164 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-068ce943-9107-4253-96c1-b30cb74e74af tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:57.026942 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-068ce943-9107-4253-96c1-b30cb74e74af tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:57.027559 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-068ce943-9107-4253-96c1-b30cb74e74af tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:57.052831 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-78b6ff5a-1931-4124-84c5-6dc5d04feb82 req-01750754-d390-464a-a820-923643b65e18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7c81c3-cb32-476d-97c8-9a0d8d19f156", "name": "network-vif-deleted", "tag": "8f627980-8d41-4f62-bfa8-683b4cdc0b4c"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:57:57.055308 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:57:57.055308 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:57:57.064193 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-068ce943-9107-4253-96c1-b30cb74e74af tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:57.064863 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-068ce943-9107-4253-96c1-b30cb74e74af tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:57.065461 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.objects.instance [None req-068ce943-9107-4253-96c1-b30cb74e74af tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lazy-loading 'fault' on Instance uuid fe7c81c3-cb32-476d-97c8-9a0d8d19f156 {{(pid=122564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:57:57.067674 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-78b6ff5a-1931-4124-84c5-6dc5d04feb82 req-01750754-d390-464a-a820-923643b65e18 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:57.068419 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-78b6ff5a-1931-4124-84c5-6dc5d04feb82 req-01750754-d390-464a-a820-923643b65e18 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:57.082822 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-78b6ff5a-1931-4124-84c5-6dc5d04feb82 req-01750754-d390-464a-a820-923643b65e18 service nova] Creating event network-vif-deleted:8f627980-8d41-4f62-bfa8-683b4cdc0b4c for instance fe7c81c3-cb32-476d-97c8-9a0d8d19f156 on hv-cinder-76845 Nov 21 13:57:57.089772 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-78b6ff5a-1931-4124-84c5-6dc5d04feb82 req-01750754-d390-464a-a820-923643b65e18 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039736 Nov 21 13:57:57.097644 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 453/908] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:57:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:57:57.121204 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-068ce943-9107-4253-96c1-b30cb74e74af tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07abcb2febc44ec8a0a2493b53233a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389c281a19bb49e583633f57108f7f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:57:57.132445 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-068ce943-9107-4253-96c1-b30cb74e74af tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156" status: 200 len: 1328 microversion: 2.1 time: 0.117150 Nov 21 13:57:57.134675 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 456/909] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:57:57 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156 => generated 1328 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:57:58.150921 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-f51de1b1-20d0-476f-b503-b6b8329f3eb8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:58.152457 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-f51de1b1-20d0-476f-b503-b6b8329f3eb8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:57:58.159693 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f51de1b1-20d0-476f-b503-b6b8329f3eb8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:58.160183 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f51de1b1-20d0-476f-b503-b6b8329f3eb8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:58.161218 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f51de1b1-20d0-476f-b503-b6b8329f3eb8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:57:58.161967 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f51de1b1-20d0-476f-b503-b6b8329f3eb8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:57:58.176141 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-f51de1b1-20d0-476f-b503-b6b8329f3eb8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] HTTP exception thrown: Instance fe7c81c3-cb32-476d-97c8-9a0d8d19f156 could not be found. Nov 21 13:57:58.176742 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-f51de1b1-20d0-476f-b503-b6b8329f3eb8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Returning 404 to user: Instance fe7c81c3-cb32-476d-97c8-9a0d8d19f156 could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:57:58.177710 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-f51de1b1-20d0-476f-b503-b6b8329f3eb8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156" status: 404 len: 111 microversion: 2.1 time: 0.031531 Nov 21 13:57:58.183299 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 454/910] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:57:58 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:57:58.186806 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-87517efe-b424-419c-91e5-3f33692d27c2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '.version_select at 0x7fd513b73310>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:57:58.207047 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-87517efe-b424-419c-91e5-3f33692d27c2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1263095797" status: 202 len: 0 microversion: 2.1 time: 0.023983 Nov 21 13:57:58.208029 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 457/911] 10.222.0.11 () {58 vars in 1220 bytes} [Sun Nov 21 13:57:58 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1263095797 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:58:01.667122 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-7c49f5f9-05b4-4bf8-9509-320fa5191aad tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:01.668372 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-7c49f5f9-05b4-4bf8-9509-320fa5191aad tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:01.675236 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7c49f5f9-05b4-4bf8-9509-320fa5191aad tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:01.675986 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7c49f5f9-05b4-4bf8-9509-320fa5191aad tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:01.677118 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7c49f5f9-05b4-4bf8-9509-320fa5191aad tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:01.677778 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7c49f5f9-05b4-4bf8-9509-320fa5191aad tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:01.694202 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-7c49f5f9-05b4-4bf8-9509-320fa5191aad tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] HTTP exception thrown: Instance fe7c81c3-cb32-476d-97c8-9a0d8d19f156 could not be found. Nov 21 13:58:01.694807 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-7c49f5f9-05b4-4bf8-9509-320fa5191aad tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Returning 404 to user: Instance fe7c81c3-cb32-476d-97c8-9a0d8d19f156 could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:58:01.695830 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-7c49f5f9-05b4-4bf8-9509-320fa5191aad tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "DELETE /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156" status: 404 len: 111 microversion: 2.1 time: 0.032731 Nov 21 13:58:01.696857 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 455/912] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 13:58:01 2021] DELETE /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:58:01.706123 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-eb6e65b9-4477-443e-a067-bf310ebf1d6a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:01.707572 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-eb6e65b9-4477-443e-a067-bf310ebf1d6a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: fe7c81c3-cb32-476d-97c8-9a0d8d19f156] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:01.716529 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-eb6e65b9-4477-443e-a067-bf310ebf1d6a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:01.717212 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-eb6e65b9-4477-443e-a067-bf310ebf1d6a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:01.718213 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-eb6e65b9-4477-443e-a067-bf310ebf1d6a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:01.718804 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-eb6e65b9-4477-443e-a067-bf310ebf1d6a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:01.735790 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.wsgi [None req-eb6e65b9-4477-443e-a067-bf310ebf1d6a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] HTTP exception thrown: Instance fe7c81c3-cb32-476d-97c8-9a0d8d19f156 could not be found. Nov 21 13:58:01.736909 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-eb6e65b9-4477-443e-a067-bf310ebf1d6a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Returning 404 to user: Instance fe7c81c3-cb32-476d-97c8-9a0d8d19f156 could not be found. {{(pid=122564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:58:01.738099 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-eb6e65b9-4477-443e-a067-bf310ebf1d6a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156" status: 404 len: 111 microversion: 2.1 time: 0.037167 Nov 21 13:58:01.739115 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 458/913] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:01 2021] GET /compute/v2.1/servers/fe7c81c3-cb32-476d-97c8-9a0d8d19f156 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 21 13:58:02.878806 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-9e6ae89d-5191-48cb-a770-60e4e9227236 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:02.879694 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-9e6ae89d-5191-48cb-a770-60e4e9227236 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:02.886221 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9e6ae89d-5191-48cb-a770-60e4e9227236 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:02.886765 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9e6ae89d-5191-48cb-a770-60e4e9227236 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:02.888027 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9e6ae89d-5191-48cb-a770-60e4e9227236 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:02.889200 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9e6ae89d-5191-48cb-a770-60e4e9227236 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:02.904790 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-9e6ae89d-5191-48cb-a770-60e4e9227236 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] HTTP exception thrown: Instance 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb could not be found. Nov 21 13:58:02.905745 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-9e6ae89d-5191-48cb-a770-60e4e9227236 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Returning 404 to user: Instance 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:58:02.906588 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-9e6ae89d-5191-48cb-a770-60e4e9227236 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "DELETE /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 404 len: 111 microversion: 2.1 time: 0.032446 Nov 21 13:58:02.907145 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 456/914] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 13:58:02 2021] DELETE /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:58:02.914933 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b097d86d-1848-4c02-9914-5143e85a24b6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:02.915551 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b097d86d-1848-4c02-9914-5143e85a24b6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] [instance: 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:02.925535 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b097d86d-1848-4c02-9914-5143e85a24b6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:02.926001 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b097d86d-1848-4c02-9914-5143e85a24b6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:02.926798 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b097d86d-1848-4c02-9914-5143e85a24b6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:02.927342 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b097d86d-1848-4c02-9914-5143e85a24b6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:02.948353 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.wsgi [None req-b097d86d-1848-4c02-9914-5143e85a24b6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] HTTP exception thrown: Instance 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb could not be found. Nov 21 13:58:02.948992 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b097d86d-1848-4c02-9914-5143e85a24b6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Returning 404 to user: Instance 1aa7ec26-0d3e-4d40-87d2-45e63ed435eb could not be found. {{(pid=122564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:58:02.949850 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-b097d86d-1848-4c02-9914-5143e85a24b6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb" status: 404 len: 111 microversion: 2.1 time: 0.038635 Nov 21 13:58:02.950715 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 459/915] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:02 2021] GET /compute/v2.1/servers/1aa7ec26-0d3e-4d40-87d2-45e63ed435eb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:58:08.312659 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1594730817", "imageRef": "acdb574e-2ba9-4029-849b-377b4d5722ce", "flavorRef": "452", "networks": [{"uuid": "e593a34f-1f09-493d-aafd-a51b70c22643"}]}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:58:08.365546 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.network.neutron [None req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] validate_networks() for [('e593a34f-1f09-493d-aafd-a51b70c22643', None, None, None, None, None)] {{(pid=122565) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 21 13:58:08.742915 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Flavor limits 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 13:58:08.743372 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Image limits 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 13:58:08.743877 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Flavor pref 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 13:58:08.744290 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Image pref 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 13:58:08.744752 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 13:58:08.753418 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:08.753864 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:08.754673 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:08.755106 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:08.771249 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Getting quotas for project 48fbf7b5fd2347789241c7658fd6bb83. Resources: {'instances', 'ram', 'cores'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:58:08.775050 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Getting quotas for user 407502700533436dbeaad32a12fb5d90 and project 48fbf7b5fd2347789241c7658fd6bb83. Resources: {'instances', 'ram', 'cores'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:58:08.786982 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Going to run 1 instances... {{(pid=122565) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 13:58:08.789345 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='acdb574e-2ba9-4029-849b-377b4d5722ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 13:58:08.833716 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.633777 Nov 21 13:58:08.834365 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 457/916] 10.222.0.11 () {60 vars in 1146 bytes} [Sun Nov 21 13:58:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 13:58:08.843819 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-feea7ae5-d063-407f-8a80-d437a5a81169 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:08.844524 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-feea7ae5-d063-407f-8a80-d437a5a81169 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:08.897673 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-feea7ae5-d063-407f-8a80-d437a5a81169 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:08.904318 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-feea7ae5-d063-407f-8a80-d437a5a81169 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e" status: 200 len: 1218 microversion: 2.1 time: 0.064180 Nov 21 13:58:08.904949 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 460/917] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:08 2021] GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:09.920307 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-dcaa8e19-3d4b-477c-a102-f87d6d6a47a3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:09.920946 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-dcaa8e19-3d4b-477c-a102-f87d6d6a47a3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:09.927899 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dcaa8e19-3d4b-477c-a102-f87d6d6a47a3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:09.928364 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dcaa8e19-3d4b-477c-a102-f87d6d6a47a3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:09.929147 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dcaa8e19-3d4b-477c-a102-f87d6d6a47a3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:09.929586 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-dcaa8e19-3d4b-477c-a102-f87d6d6a47a3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:09.998094 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-dcaa8e19-3d4b-477c-a102-f87d6d6a47a3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:10.005593 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-dcaa8e19-3d4b-477c-a102-f87d6d6a47a3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e" status: 200 len: 1276 microversion: 2.1 time: 0.089031 Nov 21 13:58:10.006516 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 458/918] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:09 2021] GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e => generated 1276 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:10.997307 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-2316adce-ec70-434c-9057-d07d35d79955 req-221ca9e8-5dd6-4621-879f-6a271ffdd8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f927cd1-a768-4be7-9ed5-6ea5ee46da8e", "tag": "311b993c-d963-4bbd-9dd2-91f64ff1d918"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:58:10.999126 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:58:10.999126 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:58:11.009778 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-2316adce-ec70-434c-9057-d07d35d79955 req-221ca9e8-5dd6-4621-879f-6a271ffdd8d2 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:11.010222 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-2316adce-ec70-434c-9057-d07d35d79955 req-221ca9e8-5dd6-4621-879f-6a271ffdd8d2 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:11.022080 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-b40c4f8c-49f8-4b47-a145-3c8900f30fbb tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:11.023232 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-b40c4f8c-49f8-4b47-a145-3c8900f30fbb tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:11.030697 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-2316adce-ec70-434c-9057-d07d35d79955 req-221ca9e8-5dd6-4621-879f-6a271ffdd8d2 service nova] Creating event network-changed:311b993c-d963-4bbd-9dd2-91f64ff1d918 for instance 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e on hv-cinder-76845 Nov 21 13:58:11.036191 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-2316adce-ec70-434c-9057-d07d35d79955 req-221ca9e8-5dd6-4621-879f-6a271ffdd8d2 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042375 Nov 21 13:58:11.037035 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 461/919] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:58:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:58:11.037878 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b40c4f8c-49f8-4b47-a145-3c8900f30fbb tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:11.038327 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b40c4f8c-49f8-4b47-a145-3c8900f30fbb tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:11.039119 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b40c4f8c-49f8-4b47-a145-3c8900f30fbb tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:11.039551 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b40c4f8c-49f8-4b47-a145-3c8900f30fbb tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:11.249067 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-b40c4f8c-49f8-4b47-a145-3c8900f30fbb tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:11.256441 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-b40c4f8c-49f8-4b47-a145-3c8900f30fbb tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e" status: 200 len: 1318 microversion: 2.1 time: 0.237926 Nov 21 13:58:11.257037 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 459/920] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:11 2021] GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:58:12.276122 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-316fcdae-70ef-459d-89f1-185294a0ce72 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:12.276903 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-316fcdae-70ef-459d-89f1-185294a0ce72 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:12.283349 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-316fcdae-70ef-459d-89f1-185294a0ce72 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:12.283831 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-316fcdae-70ef-459d-89f1-185294a0ce72 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:12.284636 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-316fcdae-70ef-459d-89f1-185294a0ce72 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:12.285082 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-316fcdae-70ef-459d-89f1-185294a0ce72 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:12.422950 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-316fcdae-70ef-459d-89f1-185294a0ce72 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:12.430165 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-316fcdae-70ef-459d-89f1-185294a0ce72 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e" status: 200 len: 1318 microversion: 2.1 time: 0.160785 Nov 21 13:58:12.430724 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 462/921] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:12 2021] GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:13.447498 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-0727a460-7213-4f73-a5e1-8c600b480fec tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:13.448090 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-0727a460-7213-4f73-a5e1-8c600b480fec tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:13.455097 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0727a460-7213-4f73-a5e1-8c600b480fec tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:13.455830 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0727a460-7213-4f73-a5e1-8c600b480fec tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:13.456676 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0727a460-7213-4f73-a5e1-8c600b480fec tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:13.457083 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0727a460-7213-4f73-a5e1-8c600b480fec tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:13.586232 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-0727a460-7213-4f73-a5e1-8c600b480fec tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:13.593521 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-0727a460-7213-4f73-a5e1-8c600b480fec tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e" status: 200 len: 1318 microversion: 2.1 time: 0.149756 Nov 21 13:58:13.594091 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 460/922] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:13 2021] GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:14.610571 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-88a4887f-a866-48b4-8001-4d68e695e891 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:14.611121 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-88a4887f-a866-48b4-8001-4d68e695e891 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:14.617052 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-88a4887f-a866-48b4-8001-4d68e695e891 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:14.617494 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-88a4887f-a866-48b4-8001-4d68e695e891 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:14.618263 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-88a4887f-a866-48b4-8001-4d68e695e891 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:14.618695 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-88a4887f-a866-48b4-8001-4d68e695e891 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:14.744895 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-88a4887f-a866-48b4-8001-4d68e695e891 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:14.752891 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-88a4887f-a866-48b4-8001-4d68e695e891 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e" status: 200 len: 1318 microversion: 2.1 time: 0.146724 Nov 21 13:58:14.753455 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 463/923] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:14 2021] GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:15.271303 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-3a3318b9-5ec4-4c90-bbd7-e3e8fa41de5e req-aad4378c-7d39-4224-81fb-6f26084b57e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f927cd1-a768-4be7-9ed5-6ea5ee46da8e", "name": "network-vif-plugged", "status": "completed", "tag": "311b993c-d963-4bbd-9dd2-91f64ff1d918"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:58:15.272967 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:58:15.272967 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:58:15.280571 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-3a3318b9-5ec4-4c90-bbd7-e3e8fa41de5e req-aad4378c-7d39-4224-81fb-6f26084b57e3 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:15.281010 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-3a3318b9-5ec4-4c90-bbd7-e3e8fa41de5e req-aad4378c-7d39-4224-81fb-6f26084b57e3 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:15.292493 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-3a3318b9-5ec4-4c90-bbd7-e3e8fa41de5e req-aad4378c-7d39-4224-81fb-6f26084b57e3 service nova] Creating event network-vif-plugged:311b993c-d963-4bbd-9dd2-91f64ff1d918 for instance 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e on hv-cinder-76845 Nov 21 13:58:15.298041 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-3a3318b9-5ec4-4c90-bbd7-e3e8fa41de5e req-aad4378c-7d39-4224-81fb-6f26084b57e3 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029874 Nov 21 13:58:15.299201 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 461/924] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:58:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:58:15.769517 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ced5c28d-fdf7-4f70-a5c4-08db3e1c1188 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:15.770082 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ced5c28d-fdf7-4f70-a5c4-08db3e1c1188 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:15.776393 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ced5c28d-fdf7-4f70-a5c4-08db3e1c1188 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:15.776847 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ced5c28d-fdf7-4f70-a5c4-08db3e1c1188 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:15.777658 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ced5c28d-fdf7-4f70-a5c4-08db3e1c1188 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:15.778095 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ced5c28d-fdf7-4f70-a5c4-08db3e1c1188 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:15.909624 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-ced5c28d-fdf7-4f70-a5c4-08db3e1c1188 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:15.916911 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ced5c28d-fdf7-4f70-a5c4-08db3e1c1188 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e" status: 200 len: 1318 microversion: 2.1 time: 0.151187 Nov 21 13:58:15.917484 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 464/925] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:15 2021] GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:16.934338 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-36c15fad-1269-40a9-aeb4-2db21bb6f93c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:16.935031 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-36c15fad-1269-40a9-aeb4-2db21bb6f93c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:16.941099 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-36c15fad-1269-40a9-aeb4-2db21bb6f93c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:16.941545 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-36c15fad-1269-40a9-aeb4-2db21bb6f93c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:16.942317 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-36c15fad-1269-40a9-aeb4-2db21bb6f93c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:16.942747 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-36c15fad-1269-40a9-aeb4-2db21bb6f93c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:17.073055 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-36c15fad-1269-40a9-aeb4-2db21bb6f93c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:17.080269 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-36c15fad-1269-40a9-aeb4-2db21bb6f93c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e" status: 200 len: 1508 microversion: 2.1 time: 0.150352 Nov 21 13:58:17.080836 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 462/926] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:16 2021] GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:18.407189 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-15dfd3df-17a3-4bff-a5f6-e658f9ecdd09 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "beff83d9-fc78-4619-bf3c-2175f4d34969"}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:58:18.408272 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-15dfd3df-17a3-4bff-a5f6-e658f9ecdd09 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:18.414513 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-15dfd3df-17a3-4bff-a5f6-e658f9ecdd09 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:18.414957 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-15dfd3df-17a3-4bff-a5f6-e658f9ecdd09 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:18.415732 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-15dfd3df-17a3-4bff-a5f6-e658f9ecdd09 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:18.416197 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-15dfd3df-17a3-4bff-a5f6-e658f9ecdd09 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:18.637838 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-15dfd3df-17a3-4bff-a5f6-e658f9ecdd09 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "POST /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.234206 Nov 21 13:58:18.638437 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 465/927] 10.222.0.11 () {60 vars in 1322 bytes} [Sun Nov 21 13:58:18 2021] POST /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e/os-volume_attachments => generated 194 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:58:25.087654 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-654618745", "imageRef": "acdb574e-2ba9-4029-849b-377b4d5722ce", "flavorRef": "452", "networks": [{"uuid": "e593a34f-1f09-493d-aafd-a51b70c22643"}]}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:58:25.139103 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.network.neutron [None req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] validate_networks() for [('e593a34f-1f09-493d-aafd-a51b70c22643', None, None, None, None, None)] {{(pid=122565) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 21 13:58:25.497498 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Flavor limits 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 13:58:25.497927 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Image limits 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 13:58:25.498404 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Flavor pref 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 13:58:25.499085 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Image pref 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 13:58:25.499497 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 13:58:25.508935 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:25.509382 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:25.510193 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:25.510633 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:25.527248 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Getting quotas for project 48fbf7b5fd2347789241c7658fd6bb83. Resources: {'instances', 'ram', 'cores'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:58:25.531677 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Getting quotas for user 407502700533436dbeaad32a12fb5d90 and project 48fbf7b5fd2347789241c7658fd6bb83. Resources: {'instances', 'ram', 'cores'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:58:25.542208 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Going to run 1 instances... {{(pid=122565) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 13:58:25.545414 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 23e6a833-20e6-4882-89ae-bd33ce5e4b48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='acdb574e-2ba9-4029-849b-377b4d5722ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 13:58:25.590266 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506189 Nov 21 13:58:25.590925 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 463/928] 10.222.0.11 () {60 vars in 1146 bytes} [Sun Nov 21 13:58:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 13:58:25.602193 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-44e75575-9943-474d-9550-297552e4a4b5 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:25.602890 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-44e75575-9943-474d-9550-297552e4a4b5 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 23e6a833-20e6-4882-89ae-bd33ce5e4b48] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:25.657821 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-44e75575-9943-474d-9550-297552e4a4b5 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:25.664403 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-44e75575-9943-474d-9550-297552e4a4b5 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48" status: 200 len: 1217 microversion: 2.1 time: 0.066772 Nov 21 13:58:25.665048 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 466/929] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:25 2021] GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48 => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:26.682723 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-408e8930-a338-45a0-99ab-0b4d276280ab tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:26.683379 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-408e8930-a338-45a0-99ab-0b4d276280ab tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 23e6a833-20e6-4882-89ae-bd33ce5e4b48] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:26.690016 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-408e8930-a338-45a0-99ab-0b4d276280ab tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:26.690484 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-408e8930-a338-45a0-99ab-0b4d276280ab tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:26.691276 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-408e8930-a338-45a0-99ab-0b4d276280ab tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:26.691717 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-408e8930-a338-45a0-99ab-0b4d276280ab tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:26.762898 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-408e8930-a338-45a0-99ab-0b4d276280ab tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:26.770151 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-408e8930-a338-45a0-99ab-0b4d276280ab tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48" status: 200 len: 1275 microversion: 2.1 time: 0.092613 Nov 21 13:58:26.770714 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 464/930] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:26 2021] GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48 => generated 1275 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:27.796091 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-953059bd-78ac-49de-9972-199a9f73a167 req-ccb6b808-88f6-4acb-8449-48d85a839992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23e6a833-20e6-4882-89ae-bd33ce5e4b48", "tag": "cee3a926-deeb-40c7-8cda-e34f3786308a"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:58:27.798291 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ac6716f5-8606-4d1e-9260-9668c6162b2a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:27.798981 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ac6716f5-8606-4d1e-9260-9668c6162b2a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 23e6a833-20e6-4882-89ae-bd33ce5e4b48] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:27.802214 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:58:27.802214 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:58:27.821722 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ac6716f5-8606-4d1e-9260-9668c6162b2a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:27.824188 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-953059bd-78ac-49de-9972-199a9f73a167 req-ccb6b808-88f6-4acb-8449-48d85a839992 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:27.824638 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-953059bd-78ac-49de-9972-199a9f73a167 req-ccb6b808-88f6-4acb-8449-48d85a839992 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:27.827619 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ac6716f5-8606-4d1e-9260-9668c6162b2a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:27.828475 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ac6716f5-8606-4d1e-9260-9668c6162b2a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:27.828911 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ac6716f5-8606-4d1e-9260-9668c6162b2a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:27.852284 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-953059bd-78ac-49de-9972-199a9f73a167 req-ccb6b808-88f6-4acb-8449-48d85a839992 service nova] Creating event network-changed:cee3a926-deeb-40c7-8cda-e34f3786308a for instance 23e6a833-20e6-4882-89ae-bd33ce5e4b48 on hv-cinder-76845 Nov 21 13:58:27.859067 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-953059bd-78ac-49de-9972-199a9f73a167 req-ccb6b808-88f6-4acb-8449-48d85a839992 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072561 Nov 21 13:58:27.862060 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 465/931] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:58:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:58:28.087262 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-ac6716f5-8606-4d1e-9260-9668c6162b2a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:28.096034 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ac6716f5-8606-4d1e-9260-9668c6162b2a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48" status: 200 len: 1317 microversion: 2.1 time: 0.312140 Nov 21 13:58:28.096743 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 467/932] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:27 2021] GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48 => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:28.181992 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-815c7b62-18a6-4038-ac0c-303b5a3b438c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:28.182614 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-815c7b62-18a6-4038-ac0c-303b5a3b438c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:28.189504 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-815c7b62-18a6-4038-ac0c-303b5a3b438c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:28.190192 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-815c7b62-18a6-4038-ac0c-303b5a3b438c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:28.191168 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-815c7b62-18a6-4038-ac0c-303b5a3b438c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:28.191609 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-815c7b62-18a6-4038-ac0c-303b5a3b438c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:28.220975 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-815c7b62-18a6-4038-ac0c-303b5a3b438c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Going to try to terminate instance {{(pid=122565) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 21 13:58:28.277598 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-1486a9cf-0365-45c1-824a-bad3a672f1fd req-37e2f9c3-8bc2-49ef-8885-7138b36a624b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2707c966-28e3-43ba-9241-d5629ba92b06", "tag": "5907d47d-9ae0-44a4-adf8-9e5e784f851a"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:58:28.279185 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:58:28.279185 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:58:28.287113 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-1486a9cf-0365-45c1-824a-bad3a672f1fd req-37e2f9c3-8bc2-49ef-8885-7138b36a624b service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:28.287628 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-1486a9cf-0365-45c1-824a-bad3a672f1fd req-37e2f9c3-8bc2-49ef-8885-7138b36a624b service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:28.300466 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-1486a9cf-0365-45c1-824a-bad3a672f1fd req-37e2f9c3-8bc2-49ef-8885-7138b36a624b service nova] Creating event network-changed:5907d47d-9ae0-44a4-adf8-9e5e784f851a for instance 2707c966-28e3-43ba-9241-d5629ba92b06 on hv-cinder-76845 Nov 21 13:58:28.306226 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-1486a9cf-0365-45c1-824a-bad3a672f1fd req-37e2f9c3-8bc2-49ef-8885-7138b36a624b service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110858 Nov 21 13:58:28.306834 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 468/933] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:58:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:58:28.317533 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-815c7b62-18a6-4038-ac0c-303b5a3b438c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "DELETE /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 204 len: 0 microversion: 2.1 time: 0.139191 Nov 21 13:58:28.318585 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 466/934] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 13:58:28 2021] DELETE /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 13:58:28.328003 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-a6525767-e482-40a9-a6ae-e86dc782cdbf tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:28.332789 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-a6525767-e482-40a9-a6ae-e86dc782cdbf tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:28.340158 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a6525767-e482-40a9-a6ae-e86dc782cdbf tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:28.340846 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a6525767-e482-40a9-a6ae-e86dc782cdbf tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:28.341643 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a6525767-e482-40a9-a6ae-e86dc782cdbf tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:28.342084 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-a6525767-e482-40a9-a6ae-e86dc782cdbf tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:28.483989 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-a6525767-e482-40a9-a6ae-e86dc782cdbf tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:28.491713 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-a6525767-e482-40a9-a6ae-e86dc782cdbf tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1569 microversion: 2.1 time: 0.167974 Nov 21 13:58:28.492416 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 469/935] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:28 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:29.114240 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-514a56ee-d4c9-4713-8f23-ff2853f80fcf tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:29.114773 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-514a56ee-d4c9-4713-8f23-ff2853f80fcf tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 23e6a833-20e6-4882-89ae-bd33ce5e4b48] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:29.120855 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-514a56ee-d4c9-4713-8f23-ff2853f80fcf tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:29.121307 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-514a56ee-d4c9-4713-8f23-ff2853f80fcf tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:29.122082 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-514a56ee-d4c9-4713-8f23-ff2853f80fcf tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:29.122514 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-514a56ee-d4c9-4713-8f23-ff2853f80fcf tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:29.256123 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-514a56ee-d4c9-4713-8f23-ff2853f80fcf tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:29.263261 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-514a56ee-d4c9-4713-8f23-ff2853f80fcf tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48" status: 200 len: 1317 microversion: 2.1 time: 0.153967 Nov 21 13:58:29.263844 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 467/936] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:29 2021] GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:58:29.511440 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-7de3f60d-95e4-40df-a805-d0bdd8f2756d tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:29.512107 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-7de3f60d-95e4-40df-a805-d0bdd8f2756d tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:29.518872 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7de3f60d-95e4-40df-a805-d0bdd8f2756d tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:29.519319 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7de3f60d-95e4-40df-a805-d0bdd8f2756d tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:29.520115 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7de3f60d-95e4-40df-a805-d0bdd8f2756d tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:29.520551 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7de3f60d-95e4-40df-a805-d0bdd8f2756d tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:29.647570 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-7de3f60d-95e4-40df-a805-d0bdd8f2756d tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:29.654858 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-7de3f60d-95e4-40df-a805-d0bdd8f2756d tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1451 microversion: 2.1 time: 0.147299 Nov 21 13:58:29.655426 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 470/937] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:29 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:30.155273 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-0f45bd78-b8be-4b4d-af3a-534c86312bcc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:30.156294 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-0f45bd78-b8be-4b4d-af3a-534c86312bcc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:30.162463 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0f45bd78-b8be-4b4d-af3a-534c86312bcc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:30.162917 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0f45bd78-b8be-4b4d-af3a-534c86312bcc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:30.163697 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0f45bd78-b8be-4b4d-af3a-534c86312bcc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:30.164167 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0f45bd78-b8be-4b4d-af3a-534c86312bcc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:30.195978 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-0f45bd78-b8be-4b4d-af3a-534c86312bcc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044345 Nov 21 13:58:30.196862 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 468/938] 10.222.0.11 () {60 vars in 1342 bytes} [Sun Nov 21 13:58:30 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:30.253865 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-005b061a-6773-4422-aa98-693d2cee11ff tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:30.254439 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-005b061a-6773-4422-aa98-693d2cee11ff tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:30.260273 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-005b061a-6773-4422-aa98-693d2cee11ff tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:30.260792 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-005b061a-6773-4422-aa98-693d2cee11ff tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:30.261635 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-005b061a-6773-4422-aa98-693d2cee11ff tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:30.262070 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-005b061a-6773-4422-aa98-693d2cee11ff tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:30.280041 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c81cc5d4-9ec5-468e-b166-4339638c888e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:30.280718 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-c81cc5d4-9ec5-468e-b166-4339638c888e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 23e6a833-20e6-4882-89ae-bd33ce5e4b48] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:30.289725 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c81cc5d4-9ec5-468e-b166-4339638c888e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:30.290020 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c81cc5d4-9ec5-468e-b166-4339638c888e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:30.290850 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c81cc5d4-9ec5-468e-b166-4339638c888e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:30.291435 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c81cc5d4-9ec5-468e-b166-4339638c888e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:30.292596 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-005b061a-6773-4422-aa98-693d2cee11ff tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Going to try to terminate instance {{(pid=122564) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 21 13:58:30.374303 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-005b061a-6773-4422-aa98-693d2cee11ff tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "DELETE /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 204 len: 0 microversion: 2.20 time: 0.124264 Nov 21 13:58:30.378047 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 471/939] 10.222.0.11 () {60 vars in 1279 bytes} [Sun Nov 21 13:58:30 2021] DELETE /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 21 13:58:30.383498 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-771b85df-5de5-4a97-afbd-efc0393a1331 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:30.384258 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-771b85df-5de5-4a97-afbd-efc0393a1331 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:30.390469 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-771b85df-5de5-4a97-afbd-efc0393a1331 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:30.390923 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-771b85df-5de5-4a97-afbd-efc0393a1331 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:30.391722 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-771b85df-5de5-4a97-afbd-efc0393a1331 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:30.392208 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-771b85df-5de5-4a97-afbd-efc0393a1331 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:30.533269 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-771b85df-5de5-4a97-afbd-efc0393a1331 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:30.541484 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-771b85df-5de5-4a97-afbd-efc0393a1331 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:30.542984 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-771b85df-5de5-4a97-afbd-efc0393a1331 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:30.544213 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-771b85df-5de5-4a97-afbd-efc0393a1331 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1725 microversion: 2.20 time: 0.164892 Nov 21 13:58:30.544779 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 472/940] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:58:30 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:58:30.673031 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-c8802979-5bd5-4ce3-8f14-bbfe53feef10 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:30.673559 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-c8802979-5bd5-4ce3-8f14-bbfe53feef10 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:30.679461 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c8802979-5bd5-4ce3-8f14-bbfe53feef10 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:30.679956 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c8802979-5bd5-4ce3-8f14-bbfe53feef10 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:30.680755 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c8802979-5bd5-4ce3-8f14-bbfe53feef10 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:30.681195 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c8802979-5bd5-4ce3-8f14-bbfe53feef10 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:30.784668 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-c81cc5d4-9ec5-468e-b166-4339638c888e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:30.792049 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c81cc5d4-9ec5-468e-b166-4339638c888e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48" status: 200 len: 1317 microversion: 2.1 time: 0.515776 Nov 21 13:58:30.792845 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 469/941] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:30 2021] GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48 => generated 1317 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:58:30.816447 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-c8802979-5bd5-4ce3-8f14-bbfe53feef10 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c7290106424ae8bc4ddf72844fc3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:30.824692 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-c8802979-5bd5-4ce3-8f14-bbfe53feef10 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 200 len: 1451 microversion: 2.1 time: 0.156020 Nov 21 13:58:30.825444 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 473/942] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:30 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:58:30.956841 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-96b8f078-564a-477d-9d29-5a72c49f85ad req-cd3c0445-bb04-4c0d-bc8b-274c865d597b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2707c966-28e3-43ba-9241-d5629ba92b06", "name": "network-vif-deleted", "tag": "5907d47d-9ae0-44a4-adf8-9e5e784f851a"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:58:30.958346 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:58:30.958346 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:58:30.965176 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-96b8f078-564a-477d-9d29-5a72c49f85ad req-cd3c0445-bb04-4c0d-bc8b-274c865d597b service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:30.965618 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-96b8f078-564a-477d-9d29-5a72c49f85ad req-cd3c0445-bb04-4c0d-bc8b-274c865d597b service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:30.977218 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-96b8f078-564a-477d-9d29-5a72c49f85ad req-cd3c0445-bb04-4c0d-bc8b-274c865d597b service nova] Creating event network-vif-deleted:5907d47d-9ae0-44a4-adf8-9e5e784f851a for instance 2707c966-28e3-43ba-9241-d5629ba92b06 on hv-cinder-76845 Nov 21 13:58:30.982004 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-96b8f078-564a-477d-9d29-5a72c49f85ad req-cd3c0445-bb04-4c0d-bc8b-274c865d597b service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029257 Nov 21 13:58:30.982628 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 470/943] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:58:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:58:31.562830 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-3b074948-5542-4029-a04a-7a7915bc6d9b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:31.563467 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3b074948-5542-4029-a04a-7a7915bc6d9b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:31.569718 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3b074948-5542-4029-a04a-7a7915bc6d9b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:31.570174 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3b074948-5542-4029-a04a-7a7915bc6d9b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:31.570952 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3b074948-5542-4029-a04a-7a7915bc6d9b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:31.571389 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3b074948-5542-4029-a04a-7a7915bc6d9b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:31.704768 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-3b074948-5542-4029-a04a-7a7915bc6d9b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:31.718643 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-3b074948-5542-4029-a04a-7a7915bc6d9b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:31.720301 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-3b074948-5542-4029-a04a-7a7915bc6d9b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:31.721925 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-3b074948-5542-4029-a04a-7a7915bc6d9b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1725 microversion: 2.20 time: 0.163283 Nov 21 13:58:31.722495 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 474/944] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:58:31 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:58:31.809744 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-bdcc46a9-795e-4bf0-b845-420d8145aa32 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:31.810449 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-bdcc46a9-795e-4bf0-b845-420d8145aa32 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 23e6a833-20e6-4882-89ae-bd33ce5e4b48] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:31.817071 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bdcc46a9-795e-4bf0-b845-420d8145aa32 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:31.817524 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bdcc46a9-795e-4bf0-b845-420d8145aa32 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:31.818309 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bdcc46a9-795e-4bf0-b845-420d8145aa32 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:31.818755 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bdcc46a9-795e-4bf0-b845-420d8145aa32 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:31.842257 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-dedacd1d-2d1d-47d3-89e9-964661f80cde tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:31.842869 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-dedacd1d-2d1d-47d3-89e9-964661f80cde tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] [instance: 2707c966-28e3-43ba-9241-d5629ba92b06] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:31.848962 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-dedacd1d-2d1d-47d3-89e9-964661f80cde tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:31.849445 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-dedacd1d-2d1d-47d3-89e9-964661f80cde tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:31.850240 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-dedacd1d-2d1d-47d3-89e9-964661f80cde tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:31.850684 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-dedacd1d-2d1d-47d3-89e9-964661f80cde tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:31.864145 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.wsgi [None req-dedacd1d-2d1d-47d3-89e9-964661f80cde tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] HTTP exception thrown: Instance 2707c966-28e3-43ba-9241-d5629ba92b06 could not be found. Nov 21 13:58:31.864738 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-dedacd1d-2d1d-47d3-89e9-964661f80cde tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Returning 404 to user: Instance 2707c966-28e3-43ba-9241-d5629ba92b06 could not be found. {{(pid=122564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:58:31.865567 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-dedacd1d-2d1d-47d3-89e9-964661f80cde tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06" status: 404 len: 111 microversion: 2.1 time: 0.027603 Nov 21 13:58:31.866191 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 475/945] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:31 2021] GET /compute/v2.1/servers/2707c966-28e3-43ba-9241-d5629ba92b06 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:58:31.953909 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-bdcc46a9-795e-4bf0-b845-420d8145aa32 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:31.961329 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-bdcc46a9-795e-4bf0-b845-420d8145aa32 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48" status: 200 len: 1317 microversion: 2.1 time: 0.156121 Nov 21 13:58:31.962095 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 471/946] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:31 2021] GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:32.020727 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ba566503-fe58-4f56-97f2-c6ff49249581 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling method '.version_select at 0x7fd513b3a670>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:32.040799 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ba566503-fe58-4f56-97f2-c6ff49249581 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1260128638" status: 202 len: 0 microversion: 2.1 time: 0.023666 Nov 21 13:58:32.045011 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 476/947] 10.222.0.11 () {58 vars in 1253 bytes} [Sun Nov 21 13:58:32 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1260128638 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:58:32.741237 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-042e97fd-c4d5-4258-92a2-ac7900707f7e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:32.741852 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-042e97fd-c4d5-4258-92a2-ac7900707f7e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:32.747707 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-042e97fd-c4d5-4258-92a2-ac7900707f7e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:32.748195 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-042e97fd-c4d5-4258-92a2-ac7900707f7e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:32.749239 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-042e97fd-c4d5-4258-92a2-ac7900707f7e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:32.750178 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-042e97fd-c4d5-4258-92a2-ac7900707f7e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:32.977999 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-efffcc34-f7a4-439c-be88-afa4bf16bcbd tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:32.978635 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-efffcc34-f7a4-439c-be88-afa4bf16bcbd tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 23e6a833-20e6-4882-89ae-bd33ce5e4b48] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:32.985002 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-efffcc34-f7a4-439c-be88-afa4bf16bcbd tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:32.985458 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-efffcc34-f7a4-439c-be88-afa4bf16bcbd tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:32.986251 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-efffcc34-f7a4-439c-be88-afa4bf16bcbd tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:32.986695 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-efffcc34-f7a4-439c-be88-afa4bf16bcbd tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:33.122637 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-efffcc34-f7a4-439c-be88-afa4bf16bcbd tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:33.123017 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-042e97fd-c4d5-4258-92a2-ac7900707f7e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:33.130663 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-efffcc34-f7a4-439c-be88-afa4bf16bcbd tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48" status: 200 len: 1317 microversion: 2.1 time: 0.156284 Nov 21 13:58:33.131566 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 477/948] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:32 2021] GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:58:33.133944 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-042e97fd-c4d5-4258-92a2-ac7900707f7e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:33.135530 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-042e97fd-c4d5-4258-92a2-ac7900707f7e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67da79fc92074be09b188b5ba9edd098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:33.136848 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-042e97fd-c4d5-4258-92a2-ac7900707f7e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 200 len: 1725 microversion: 2.20 time: 0.399405 Nov 21 13:58:33.137469 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 472/949] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:58:32 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 1725 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 13:58:33.404392 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-79c63e0a-88a7-4644-b77d-75461c596aa0 req-defeaeb7-4f44-4c00-86de-120605b7c345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23e6a833-20e6-4882-89ae-bd33ce5e4b48", "name": "network-vif-plugged", "status": "completed", "tag": "cee3a926-deeb-40c7-8cda-e34f3786308a"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:58:33.408442 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:58:33.408442 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:58:33.423850 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-79c63e0a-88a7-4644-b77d-75461c596aa0 req-defeaeb7-4f44-4c00-86de-120605b7c345 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:33.424586 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-79c63e0a-88a7-4644-b77d-75461c596aa0 req-defeaeb7-4f44-4c00-86de-120605b7c345 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:33.441706 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-79c63e0a-88a7-4644-b77d-75461c596aa0 req-defeaeb7-4f44-4c00-86de-120605b7c345 service nova] Creating event network-vif-plugged:cee3a926-deeb-40c7-8cda-e34f3786308a for instance 23e6a833-20e6-4882-89ae-bd33ce5e4b48 on hv-cinder-76845 Nov 21 13:58:33.448491 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-79c63e0a-88a7-4644-b77d-75461c596aa0 req-defeaeb7-4f44-4c00-86de-120605b7c345 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059342 Nov 21 13:58:33.450016 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 478/950] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:58:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:58:33.461032 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-e3d848ff-3c6a-4077-adf8-4faebd28abf3 req-c0400ce7-a6cb-4607-b5a5-e3c7676df531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e70a1a57-c34e-418a-b973-e938389a3fa2", "name": "network-vif-deleted", "tag": "73851145-2483-4c28-bf3b-f049e97c28cc"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:58:33.463451 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:58:33.463451 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:58:33.479528 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-e3d848ff-3c6a-4077-adf8-4faebd28abf3 req-c0400ce7-a6cb-4607-b5a5-e3c7676df531 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:33.480607 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-e3d848ff-3c6a-4077-adf8-4faebd28abf3 req-c0400ce7-a6cb-4607-b5a5-e3c7676df531 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:33.537560 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-e3d848ff-3c6a-4077-adf8-4faebd28abf3 req-c0400ce7-a6cb-4607-b5a5-e3c7676df531 service nova] Creating event network-vif-deleted:73851145-2483-4c28-bf3b-f049e97c28cc for instance e70a1a57-c34e-418a-b973-e938389a3fa2 on hv-cinder-76845 Nov 21 13:58:33.550199 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-e3d848ff-3c6a-4077-adf8-4faebd28abf3 req-c0400ce7-a6cb-4607-b5a5-e3c7676df531 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093156 Nov 21 13:58:33.568572 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 473/951] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:58:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:58:34.148261 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-aaa80464-8356-4cbd-ab3e-695c75d54792 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:34.148896 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-aaa80464-8356-4cbd-ab3e-695c75d54792 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 23e6a833-20e6-4882-89ae-bd33ce5e4b48] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:34.156283 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-e9dd244d-269f-4027-a798-048998dfd13d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:34.157720 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-e9dd244d-269f-4027-a798-048998dfd13d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:34.158322 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-aaa80464-8356-4cbd-ab3e-695c75d54792 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:34.158781 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-aaa80464-8356-4cbd-ab3e-695c75d54792 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:34.160415 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-aaa80464-8356-4cbd-ab3e-695c75d54792 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:34.161056 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-aaa80464-8356-4cbd-ab3e-695c75d54792 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:34.165525 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e9dd244d-269f-4027-a798-048998dfd13d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:34.166122 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e9dd244d-269f-4027-a798-048998dfd13d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:34.167196 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e9dd244d-269f-4027-a798-048998dfd13d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:34.167952 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e9dd244d-269f-4027-a798-048998dfd13d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:34.182664 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-e9dd244d-269f-4027-a798-048998dfd13d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] HTTP exception thrown: Instance e70a1a57-c34e-418a-b973-e938389a3fa2 could not be found. Nov 21 13:58:34.183947 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-e9dd244d-269f-4027-a798-048998dfd13d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Returning 404 to user: Instance e70a1a57-c34e-418a-b973-e938389a3fa2 could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:58:34.185176 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-e9dd244d-269f-4027-a798-048998dfd13d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 404 len: 111 microversion: 2.20 time: 0.033244 Nov 21 13:58:34.185952 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 474/952] 10.222.0.11 () {60 vars in 1276 bytes} [Sun Nov 21 13:58:34 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 21 13:58:34.195093 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-4ad710cb-d412-4036-a22b-f44f89d35ebc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '.version_select at 0x7fd513433790>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:34.217330 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-4ad710cb-d412-4036-a22b-f44f89d35ebc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647900985" status: 204 len: 0 microversion: 2.20 time: 0.026169 Nov 21 13:58:34.218328 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 475/953] 10.222.0.11 () {60 vars in 1261 bytes} [Sun Nov 21 13:58:34 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647900985 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 21 13:58:34.317272 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-aaa80464-8356-4cbd-ab3e-695c75d54792 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:34.325033 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-aaa80464-8356-4cbd-ab3e-695c75d54792 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48" status: 200 len: 1317 microversion: 2.1 time: 0.181046 Nov 21 13:58:34.325740 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 479/954] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:34 2021] GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:35.342760 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ae207fe4-f2e8-4d0f-8e56-140b33999e18 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:35.343313 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ae207fe4-f2e8-4d0f-8e56-140b33999e18 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 23e6a833-20e6-4882-89ae-bd33ce5e4b48] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:35.364421 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ae207fe4-f2e8-4d0f-8e56-140b33999e18 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:35.369800 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ae207fe4-f2e8-4d0f-8e56-140b33999e18 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:35.371106 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ae207fe4-f2e8-4d0f-8e56-140b33999e18 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:35.371913 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ae207fe4-f2e8-4d0f-8e56-140b33999e18 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:35.581681 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ae207fe4-f2e8-4d0f-8e56-140b33999e18 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:35.589003 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ae207fe4-f2e8-4d0f-8e56-140b33999e18 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48" status: 200 len: 1508 microversion: 2.1 time: 0.250702 Nov 21 13:58:35.589574 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 476/955] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:35 2021] GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48 => generated 1508 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:35.606997 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-1aaaa47f-e857-4966-9817-18bc66d40efa tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "beff83d9-fc78-4619-bf3c-2175f4d34969"}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:58:35.608249 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-1aaaa47f-e857-4966-9817-18bc66d40efa tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 23e6a833-20e6-4882-89ae-bd33ce5e4b48] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:35.615589 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1aaaa47f-e857-4966-9817-18bc66d40efa tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:35.615881 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1aaaa47f-e857-4966-9817-18bc66d40efa tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:35.616666 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1aaaa47f-e857-4966-9817-18bc66d40efa tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:35.617100 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1aaaa47f-e857-4966-9817-18bc66d40efa tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:35.703183 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.wsgi [None req-1aaaa47f-e857-4966-9817-18bc66d40efa tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] HTTP exception thrown: Invalid volume: volume beff83d9-fc78-4619-bf3c-2175f4d34969 is already attached to instances: 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e Nov 21 13:58:35.703783 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-1aaaa47f-e857-4966-9817-18bc66d40efa tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Returning 400 to user: Invalid volume: volume beff83d9-fc78-4619-bf3c-2175f4d34969 is already attached to instances: 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e {{(pid=122564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:58:35.704636 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-1aaaa47f-e857-4966-9817-18bc66d40efa tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "POST /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102468 Nov 21 13:58:35.705408 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 480/956] 10.222.0.11 () {60 vars in 1322 bytes} [Sun Nov 21 13:58:35 2021] POST /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 21 13:58:35.766665 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-1505a1a6-e15d-4a36-86d1-34cacd5f024d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:35.767172 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-1505a1a6-e15d-4a36-86d1-34cacd5f024d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:35.775349 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1505a1a6-e15d-4a36-86d1-34cacd5f024d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:35.775828 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1505a1a6-e15d-4a36-86d1-34cacd5f024d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:35.776638 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1505a1a6-e15d-4a36-86d1-34cacd5f024d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:35.777078 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1505a1a6-e15d-4a36-86d1-34cacd5f024d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:35.882873 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.objects.instance [None req-1505a1a6-e15d-4a36-86d1-34cacd5f024d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lazy-loading 'services' on Instance uuid 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e {{(pid=122565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:58:35.964770 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-1505a1a6-e15d-4a36-86d1-34cacd5f024d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "DELETE /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e/os-volume_attachments/beff83d9-fc78-4619-bf3c-2175f4d34969" status: 202 len: 0 microversion: 2.1 time: 0.202158 Nov 21 13:58:35.965555 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 477/957] 10.222.0.11 () {58 vars in 1415 bytes} [Sun Nov 21 13:58:35 2021] DELETE /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e/os-volume_attachments/beff83d9-fc78-4619-bf3c-2175f4d34969 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:58:35.973604 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-950281a5-28c4-4889-8163-d3436228321f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:35.974903 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-950281a5-28c4-4889-8163-d3436228321f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:35.987346 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-950281a5-28c4-4889-8163-d3436228321f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:35.988099 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-950281a5-28c4-4889-8163-d3436228321f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:35.988959 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-950281a5-28c4-4889-8163-d3436228321f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:35.989498 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-950281a5-28c4-4889-8163-d3436228321f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:36.027586 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-950281a5-28c4-4889-8163-d3436228321f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057338 Nov 21 13:58:36.028538 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 481/958] 10.222.0.11 () {58 vars in 1301 bytes} [Sun Nov 21 13:58:35 2021] GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:58:36.558823 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-7b8e2d27-64a8-4aca-aaff-0bb15f5cbac3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:36.559416 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-7b8e2d27-64a8-4aca-aaff-0bb15f5cbac3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:36.568219 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7b8e2d27-64a8-4aca-aaff-0bb15f5cbac3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:36.568751 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7b8e2d27-64a8-4aca-aaff-0bb15f5cbac3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:36.569619 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7b8e2d27-64a8-4aca-aaff-0bb15f5cbac3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:36.570147 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7b8e2d27-64a8-4aca-aaff-0bb15f5cbac3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:36.583406 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-7b8e2d27-64a8-4aca-aaff-0bb15f5cbac3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] HTTP exception thrown: Instance e70a1a57-c34e-418a-b973-e938389a3fa2 could not be found. Nov 21 13:58:36.584104 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-7b8e2d27-64a8-4aca-aaff-0bb15f5cbac3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Returning 404 to user: Instance e70a1a57-c34e-418a-b973-e938389a3fa2 could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:58:36.584995 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-7b8e2d27-64a8-4aca-aaff-0bb15f5cbac3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "DELETE /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 404 len: 111 microversion: 2.1 time: 0.030691 Nov 21 13:58:36.585782 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 478/959] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 13:58:36 2021] DELETE /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:58:36.594199 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ea230151-a70f-43aa-ad19-a89761f554b9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:36.594817 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ea230151-a70f-43aa-ad19-a89761f554b9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: e70a1a57-c34e-418a-b973-e938389a3fa2] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:36.600568 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ea230151-a70f-43aa-ad19-a89761f554b9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:36.601028 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ea230151-a70f-43aa-ad19-a89761f554b9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:36.601873 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ea230151-a70f-43aa-ad19-a89761f554b9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:36.602255 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ea230151-a70f-43aa-ad19-a89761f554b9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:36.616229 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.wsgi [None req-ea230151-a70f-43aa-ad19-a89761f554b9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] HTTP exception thrown: Instance e70a1a57-c34e-418a-b973-e938389a3fa2 could not be found. Nov 21 13:58:36.616956 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ea230151-a70f-43aa-ad19-a89761f554b9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Returning 404 to user: Instance e70a1a57-c34e-418a-b973-e938389a3fa2 could not be found. {{(pid=122564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:58:36.617787 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ea230151-a70f-43aa-ad19-a89761f554b9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2" status: 404 len: 111 microversion: 2.1 time: 0.027891 Nov 21 13:58:36.618330 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 482/960] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:36 2021] GET /compute/v2.1/servers/e70a1a57-c34e-418a-b973-e938389a3fa2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:58:37.039557 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-060f3d92-abd9-4408-83e6-c575f90a3031 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:37.040583 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-060f3d92-abd9-4408-83e6-c575f90a3031 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:37.046339 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-060f3d92-abd9-4408-83e6-c575f90a3031 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:37.046790 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-060f3d92-abd9-4408-83e6-c575f90a3031 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:37.047577 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-060f3d92-abd9-4408-83e6-c575f90a3031 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:37.048055 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-060f3d92-abd9-4408-83e6-c575f90a3031 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:37.076215 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-060f3d92-abd9-4408-83e6-c575f90a3031 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040327 Nov 21 13:58:37.076792 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 479/961] 10.222.0.11 () {58 vars in 1301 bytes} [Sun Nov 21 13:58:37 2021] GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:58:37.174354 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-3227df01-c3ba-4fca-8b50-1954cf28c859 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-776234769", "imageRef": "acdb574e-2ba9-4029-849b-377b4d5722ce", "flavorRef": "452", "networks": [{"uuid": "e593a34f-1f09-493d-aafd-a51b70c22643"}]}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:58:37.225008 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.network.neutron [None req-3227df01-c3ba-4fca-8b50-1954cf28c859 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] validate_networks() for [('e593a34f-1f09-493d-aafd-a51b70c22643', None, None, None, None, None)] {{(pid=122564) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 21 13:58:37.658364 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-3227df01-c3ba-4fca-8b50-1954cf28c859 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Flavor limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 13:58:37.658962 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-3227df01-c3ba-4fca-8b50-1954cf28c859 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Image limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 13:58:37.659280 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-3227df01-c3ba-4fca-8b50-1954cf28c859 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Flavor pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 13:58:37.659688 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-3227df01-c3ba-4fca-8b50-1954cf28c859 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Image pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 13:58:37.660136 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-3227df01-c3ba-4fca-8b50-1954cf28c859 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 13:58:37.668588 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3227df01-c3ba-4fca-8b50-1954cf28c859 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:37.669039 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3227df01-c3ba-4fca-8b50-1954cf28c859 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:37.669853 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3227df01-c3ba-4fca-8b50-1954cf28c859 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:37.670290 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3227df01-c3ba-4fca-8b50-1954cf28c859 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:37.686752 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-3227df01-c3ba-4fca-8b50-1954cf28c859 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Getting quotas for project 48fbf7b5fd2347789241c7658fd6bb83. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:58:37.691267 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-3227df01-c3ba-4fca-8b50-1954cf28c859 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Getting quotas for user 407502700533436dbeaad32a12fb5d90 and project 48fbf7b5fd2347789241c7658fd6bb83. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:58:37.701939 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3227df01-c3ba-4fca-8b50-1954cf28c859 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Going to run 1 instances... {{(pid=122564) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 13:58:37.704201 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3227df01-c3ba-4fca-8b50-1954cf28c859 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 31a3c09e-663c-428c-8203-cb337ece6c85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='acdb574e-2ba9-4029-849b-377b4d5722ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 13:58:37.751770 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-083ff7f4-a812-4bdf-9ec1-a64a63e02db4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:37.752381 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-083ff7f4-a812-4bdf-9ec1-a64a63e02db4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:37.756051 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-3227df01-c3ba-4fca-8b50-1954cf28c859 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585294 Nov 21 13:58:37.756881 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 483/962] 10.222.0.11 () {60 vars in 1146 bytes} [Sun Nov 21 13:58:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 13:58:37.766041 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-3298bcc7-c9bb-40a3-8e67-2283edc7ba1f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:37.766653 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3298bcc7-c9bb-40a3-8e67-2283edc7ba1f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 31a3c09e-663c-428c-8203-cb337ece6c85] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:37.792081 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-083ff7f4-a812-4bdf-9ec1-a64a63e02db4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:37.792802 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-083ff7f4-a812-4bdf-9ec1-a64a63e02db4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:37.794217 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-083ff7f4-a812-4bdf-9ec1-a64a63e02db4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:37.796148 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-083ff7f4-a812-4bdf-9ec1-a64a63e02db4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:37.820502 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-3298bcc7-c9bb-40a3-8e67-2283edc7ba1f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:37.823949 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-083ff7f4-a812-4bdf-9ec1-a64a63e02db4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] HTTP exception thrown: Instance 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 could not be found. Nov 21 13:58:37.825852 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-083ff7f4-a812-4bdf-9ec1-a64a63e02db4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Returning 404 to user: Instance 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:58:37.826980 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-083ff7f4-a812-4bdf-9ec1-a64a63e02db4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "DELETE /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 404 len: 111 microversion: 2.1 time: 0.079797 Nov 21 13:58:37.828431 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-3298bcc7-c9bb-40a3-8e67-2283edc7ba1f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85" status: 200 len: 1217 microversion: 2.1 time: 0.065642 Nov 21 13:58:37.829456 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 484/963] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:37 2021] GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85 => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:37.831219 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 480/964] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 13:58:37 2021] DELETE /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 21 13:58:37.836767 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-24895133-6163-407e-b333-5fc550341a65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:37.837528 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-24895133-6163-407e-b333-5fc550341a65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] [instance: 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:37.843917 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-24895133-6163-407e-b333-5fc550341a65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:37.844377 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-24895133-6163-407e-b333-5fc550341a65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:37.845165 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-24895133-6163-407e-b333-5fc550341a65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:37.845602 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-24895133-6163-407e-b333-5fc550341a65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:37.858953 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.wsgi [None req-24895133-6163-407e-b333-5fc550341a65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] HTTP exception thrown: Instance 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 could not be found. Nov 21 13:58:37.860101 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-24895133-6163-407e-b333-5fc550341a65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Returning 404 to user: Instance 16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 could not be found. {{(pid=122564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:58:37.860932 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-24895133-6163-407e-b333-5fc550341a65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1" status: 404 len: 111 microversion: 2.1 time: 0.028515 Nov 21 13:58:37.861607 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 485/965] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:37 2021] GET /compute/v2.1/servers/16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 21 13:58:38.845467 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-73d7e704-4efb-4a8c-b431-ff3b2095588e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:38.846676 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-73d7e704-4efb-4a8c-b431-ff3b2095588e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 31a3c09e-663c-428c-8203-cb337ece6c85] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:38.853190 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-73d7e704-4efb-4a8c-b431-ff3b2095588e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:38.853876 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-73d7e704-4efb-4a8c-b431-ff3b2095588e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:38.854827 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-73d7e704-4efb-4a8c-b431-ff3b2095588e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:38.855417 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-73d7e704-4efb-4a8c-b431-ff3b2095588e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:38.948950 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-73d7e704-4efb-4a8c-b431-ff3b2095588e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:38.962003 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-73d7e704-4efb-4a8c-b431-ff3b2095588e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85" status: 200 len: 1277 microversion: 2.1 time: 0.116589 Nov 21 13:58:38.962887 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 481/966] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:38 2021] GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85 => generated 1277 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:39.979630 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-58fb7202-d3c4-4855-b97b-bb834e30f94b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:39.985895 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-58fb7202-d3c4-4855-b97b-bb834e30f94b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 31a3c09e-663c-428c-8203-cb337ece6c85] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:40.003665 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-58fb7202-d3c4-4855-b97b-bb834e30f94b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:40.010886 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-58fb7202-d3c4-4855-b97b-bb834e30f94b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:40.012047 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-58fb7202-d3c4-4855-b97b-bb834e30f94b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:40.012717 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-58fb7202-d3c4-4855-b97b-bb834e30f94b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:40.628463 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-58fb7202-d3c4-4855-b97b-bb834e30f94b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:40.641346 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-58fb7202-d3c4-4855-b97b-bb834e30f94b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85" status: 200 len: 1317 microversion: 2.1 time: 0.665231 Nov 21 13:58:40.651907 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 486/967] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:39 2021] GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85 => generated 1317 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:40.908055 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-70a57b00-35ca-4e48-aaeb-9439f9f06563 req-c506e599-835a-40c0-95fc-464c5cc81af8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31a3c09e-663c-428c-8203-cb337ece6c85", "tag": "88b1ce6e-bceb-48d2-9c83-267045746fd4"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:58:40.911279 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:58:40.911279 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:58:40.925826 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-70a57b00-35ca-4e48-aaeb-9439f9f06563 req-c506e599-835a-40c0-95fc-464c5cc81af8 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:40.926340 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-70a57b00-35ca-4e48-aaeb-9439f9f06563 req-c506e599-835a-40c0-95fc-464c5cc81af8 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:40.939679 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-70a57b00-35ca-4e48-aaeb-9439f9f06563 req-c506e599-835a-40c0-95fc-464c5cc81af8 service nova] Creating event network-changed:88b1ce6e-bceb-48d2-9c83-267045746fd4 for instance 31a3c09e-663c-428c-8203-cb337ece6c85 on hv-cinder-76845 Nov 21 13:58:40.944892 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-70a57b00-35ca-4e48-aaeb-9439f9f06563 req-c506e599-835a-40c0-95fc-464c5cc81af8 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046483 Nov 21 13:58:40.945763 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 482/968] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:58:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:58:41.659012 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-7a7e6358-c229-40b6-9387-32d7f025b32c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:41.659639 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-7a7e6358-c229-40b6-9387-32d7f025b32c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 31a3c09e-663c-428c-8203-cb337ece6c85] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:41.665903 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7a7e6358-c229-40b6-9387-32d7f025b32c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:41.666357 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7a7e6358-c229-40b6-9387-32d7f025b32c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:41.667162 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7a7e6358-c229-40b6-9387-32d7f025b32c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:41.667586 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7a7e6358-c229-40b6-9387-32d7f025b32c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:41.815516 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-7a7e6358-c229-40b6-9387-32d7f025b32c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:41.823084 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-7a7e6358-c229-40b6-9387-32d7f025b32c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85" status: 200 len: 1317 microversion: 2.1 time: 0.168318 Nov 21 13:58:41.823660 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 487/969] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:41 2021] GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:42.840573 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-6d9197cd-6c72-4e3a-a22c-2fb5f20cb751 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:42.841267 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-6d9197cd-6c72-4e3a-a22c-2fb5f20cb751 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 31a3c09e-663c-428c-8203-cb337ece6c85] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:42.848409 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6d9197cd-6c72-4e3a-a22c-2fb5f20cb751 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:42.848856 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6d9197cd-6c72-4e3a-a22c-2fb5f20cb751 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:42.849637 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6d9197cd-6c72-4e3a-a22c-2fb5f20cb751 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:42.850075 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6d9197cd-6c72-4e3a-a22c-2fb5f20cb751 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:43.001011 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-6d9197cd-6c72-4e3a-a22c-2fb5f20cb751 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:43.008643 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-6d9197cd-6c72-4e3a-a22c-2fb5f20cb751 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85" status: 200 len: 1317 microversion: 2.1 time: 0.172021 Nov 21 13:58:43.009218 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 483/970] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:42 2021] GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:44.024806 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2a46d6d1-5dd2-4d43-87f4-2568dcbbb63d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:44.025418 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-2a46d6d1-5dd2-4d43-87f4-2568dcbbb63d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 31a3c09e-663c-428c-8203-cb337ece6c85] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:44.031665 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2a46d6d1-5dd2-4d43-87f4-2568dcbbb63d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:44.032147 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2a46d6d1-5dd2-4d43-87f4-2568dcbbb63d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:44.032923 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2a46d6d1-5dd2-4d43-87f4-2568dcbbb63d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:44.033361 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2a46d6d1-5dd2-4d43-87f4-2568dcbbb63d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:44.163306 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-2a46d6d1-5dd2-4d43-87f4-2568dcbbb63d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:44.170513 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-2a46d6d1-5dd2-4d43-87f4-2568dcbbb63d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85" status: 200 len: 1317 microversion: 2.1 time: 0.149261 Nov 21 13:58:44.171074 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 488/971] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:44 2021] GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:45.188048 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-e85a197f-d381-43ca-96d7-1987fa7f46e1 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:45.188694 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-e85a197f-d381-43ca-96d7-1987fa7f46e1 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 31a3c09e-663c-428c-8203-cb337ece6c85] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:45.194921 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e85a197f-d381-43ca-96d7-1987fa7f46e1 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:45.195372 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e85a197f-d381-43ca-96d7-1987fa7f46e1 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:45.196187 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e85a197f-d381-43ca-96d7-1987fa7f46e1 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:45.196632 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e85a197f-d381-43ca-96d7-1987fa7f46e1 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:45.392671 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-e85a197f-d381-43ca-96d7-1987fa7f46e1 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:45.400972 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-e85a197f-d381-43ca-96d7-1987fa7f46e1 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85" status: 200 len: 1317 microversion: 2.1 time: 0.217126 Nov 21 13:58:45.401544 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 484/972] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:45 2021] GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:45.451710 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-eeb9e767-9d00-415f-b3b4-6e597a8e1436 req-c285f952-9fc9-4ded-a011-a19e647801e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a3c09e-663c-428c-8203-cb337ece6c85", "name": "network-vif-plugged", "status": "completed", "tag": "88b1ce6e-bceb-48d2-9c83-267045746fd4"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:58:45.454160 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:58:45.454160 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:58:45.462526 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-eeb9e767-9d00-415f-b3b4-6e597a8e1436 req-c285f952-9fc9-4ded-a011-a19e647801e5 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:45.463513 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-eeb9e767-9d00-415f-b3b4-6e597a8e1436 req-c285f952-9fc9-4ded-a011-a19e647801e5 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:45.474864 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-eeb9e767-9d00-415f-b3b4-6e597a8e1436 req-c285f952-9fc9-4ded-a011-a19e647801e5 service nova] Creating event network-vif-plugged:88b1ce6e-bceb-48d2-9c83-267045746fd4 for instance 31a3c09e-663c-428c-8203-cb337ece6c85 on hv-cinder-76845 Nov 21 13:58:45.480083 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-eeb9e767-9d00-415f-b3b4-6e597a8e1436 req-c285f952-9fc9-4ded-a011-a19e647801e5 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032041 Nov 21 13:58:45.480942 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 489/973] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:58:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:58:46.417200 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-2954cf3c-ee04-4492-aee9-96f057071143 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:46.417812 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-2954cf3c-ee04-4492-aee9-96f057071143 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 31a3c09e-663c-428c-8203-cb337ece6c85] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:46.424600 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2954cf3c-ee04-4492-aee9-96f057071143 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:46.425103 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2954cf3c-ee04-4492-aee9-96f057071143 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:46.425810 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2954cf3c-ee04-4492-aee9-96f057071143 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:46.426241 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2954cf3c-ee04-4492-aee9-96f057071143 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:46.561502 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2954cf3c-ee04-4492-aee9-96f057071143 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:46.568909 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-2954cf3c-ee04-4492-aee9-96f057071143 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85" status: 200 len: 1317 microversion: 2.1 time: 0.155286 Nov 21 13:58:46.569483 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 485/974] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:46 2021] GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:47.587994 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-22c6e7ee-6169-4d46-b712-f952a2762a7b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:47.588593 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-22c6e7ee-6169-4d46-b712-f952a2762a7b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 31a3c09e-663c-428c-8203-cb337ece6c85] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:47.594913 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-22c6e7ee-6169-4d46-b712-f952a2762a7b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:47.595410 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-22c6e7ee-6169-4d46-b712-f952a2762a7b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:47.596217 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-22c6e7ee-6169-4d46-b712-f952a2762a7b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:47.596649 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-22c6e7ee-6169-4d46-b712-f952a2762a7b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:47.732430 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-22c6e7ee-6169-4d46-b712-f952a2762a7b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:47.739831 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-22c6e7ee-6169-4d46-b712-f952a2762a7b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85" status: 200 len: 1507 microversion: 2.1 time: 0.157581 Nov 21 13:58:47.740412 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 490/975] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:47 2021] GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:58:49.063644 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-5112defe-f39e-4ddb-b21d-4eddc45981fc tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ee81504-69df-4298-b5a4-05e57ab6fd1d"}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:58:49.064712 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-5112defe-f39e-4ddb-b21d-4eddc45981fc tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 31a3c09e-663c-428c-8203-cb337ece6c85] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:49.070776 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5112defe-f39e-4ddb-b21d-4eddc45981fc tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:49.071225 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5112defe-f39e-4ddb-b21d-4eddc45981fc tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:49.072042 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5112defe-f39e-4ddb-b21d-4eddc45981fc tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:49.072477 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-5112defe-f39e-4ddb-b21d-4eddc45981fc tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:49.304892 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-5112defe-f39e-4ddb-b21d-4eddc45981fc tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "POST /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.244751 Nov 21 13:58:49.305504 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 486/976] 10.222.0.11 () {60 vars in 1322 bytes} [Sun Nov 21 13:58:49 2021] POST /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85/os-volume_attachments => generated 194 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:58:56.779660 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2d47f80c-c10d-4d08-948c-b73229eac800 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ee81504-69df-4298-b5a4-05e57ab6fd1d"}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:58:56.780998 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-2d47f80c-c10d-4d08-948c-b73229eac800 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 31a3c09e-663c-428c-8203-cb337ece6c85] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:56.787786 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2d47f80c-c10d-4d08-948c-b73229eac800 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:56.788365 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2d47f80c-c10d-4d08-948c-b73229eac800 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:56.789167 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2d47f80c-c10d-4d08-948c-b73229eac800 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:56.789616 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2d47f80c-c10d-4d08-948c-b73229eac800 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:56.879000 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.wsgi [None req-2d47f80c-c10d-4d08-948c-b73229eac800 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] HTTP exception thrown: Invalid volume: volume 3ee81504-69df-4298-b5a4-05e57ab6fd1d is already attached to instances: 31a3c09e-663c-428c-8203-cb337ece6c85 Nov 21 13:58:56.879595 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2d47f80c-c10d-4d08-948c-b73229eac800 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Returning 400 to user: Invalid volume: volume 3ee81504-69df-4298-b5a4-05e57ab6fd1d is already attached to instances: 31a3c09e-663c-428c-8203-cb337ece6c85 {{(pid=122564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:58:56.880448 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-2d47f80c-c10d-4d08-948c-b73229eac800 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "POST /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104768 Nov 21 13:58:56.881004 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 491/977] 10.222.0.11 () {60 vars in 1322 bytes} [Sun Nov 21 13:58:56 2021] POST /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 21 13:58:56.940088 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-1fb040f7-e929-49b0-b0d5-c66788841d8f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:56.941182 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-1fb040f7-e929-49b0-b0d5-c66788841d8f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 31a3c09e-663c-428c-8203-cb337ece6c85] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:56.947275 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1fb040f7-e929-49b0-b0d5-c66788841d8f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:56.947730 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1fb040f7-e929-49b0-b0d5-c66788841d8f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:56.948551 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1fb040f7-e929-49b0-b0d5-c66788841d8f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:56.948975 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1fb040f7-e929-49b0-b0d5-c66788841d8f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:57.027632 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.objects.instance [None req-1fb040f7-e929-49b0-b0d5-c66788841d8f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lazy-loading 'services' on Instance uuid 31a3c09e-663c-428c-8203-cb337ece6c85 {{(pid=122565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:58:57.098961 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-1fb040f7-e929-49b0-b0d5-c66788841d8f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "DELETE /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85/os-volume_attachments/3ee81504-69df-4298-b5a4-05e57ab6fd1d" status: 202 len: 0 microversion: 2.1 time: 0.164208 Nov 21 13:58:57.099640 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 487/978] 10.222.0.11 () {58 vars in 1415 bytes} [Sun Nov 21 13:58:56 2021] DELETE /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85/os-volume_attachments/3ee81504-69df-4298-b5a4-05e57ab6fd1d => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:58:57.108229 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-92884bbe-5219-404b-8630-ff65dd8d2bfa tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:57.111576 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-92884bbe-5219-404b-8630-ff65dd8d2bfa tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 31a3c09e-663c-428c-8203-cb337ece6c85] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:57.118184 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-92884bbe-5219-404b-8630-ff65dd8d2bfa tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:57.118852 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-92884bbe-5219-404b-8630-ff65dd8d2bfa tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:57.119953 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-92884bbe-5219-404b-8630-ff65dd8d2bfa tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:57.120584 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-92884bbe-5219-404b-8630-ff65dd8d2bfa tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:57.155598 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-92884bbe-5219-404b-8630-ff65dd8d2bfa tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051535 Nov 21 13:58:57.156327 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 492/979] 10.222.0.11 () {58 vars in 1301 bytes} [Sun Nov 21 13:58:57 2021] GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:58:58.166771 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-fdeb6fa2-ae6c-4032-b761-163335f28e25 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:58.167831 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-fdeb6fa2-ae6c-4032-b761-163335f28e25 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 31a3c09e-663c-428c-8203-cb337ece6c85] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:58.175243 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fdeb6fa2-ae6c-4032-b761-163335f28e25 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:58.175691 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fdeb6fa2-ae6c-4032-b761-163335f28e25 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:58.176499 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fdeb6fa2-ae6c-4032-b761-163335f28e25 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:58.176934 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-fdeb6fa2-ae6c-4032-b761-163335f28e25 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:58.209827 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-fdeb6fa2-ae6c-4032-b761-163335f28e25 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045872 Nov 21 13:58:58.209827 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 488/980] 10.222.0.11 () {58 vars in 1301 bytes} [Sun Nov 21 13:58:58 2021] GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:58:58.355578 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-8a14610b-7795-435b-96b8-d469157901d4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-283940662", "imageRef": "acdb574e-2ba9-4029-849b-377b4d5722ce", "flavorRef": "452", "networks": [{"uuid": "e593a34f-1f09-493d-aafd-a51b70c22643"}]}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:58:58.409289 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.network.neutron [None req-8a14610b-7795-435b-96b8-d469157901d4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] validate_networks() for [('e593a34f-1f09-493d-aafd-a51b70c22643', None, None, None, None, None)] {{(pid=122564) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 21 13:58:58.773489 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-8a14610b-7795-435b-96b8-d469157901d4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Flavor limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 13:58:58.773906 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-8a14610b-7795-435b-96b8-d469157901d4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Image limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 13:58:58.774372 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-8a14610b-7795-435b-96b8-d469157901d4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Flavor pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 13:58:58.774778 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-8a14610b-7795-435b-96b8-d469157901d4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Image pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 13:58:58.775185 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-8a14610b-7795-435b-96b8-d469157901d4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 13:58:58.784208 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8a14610b-7795-435b-96b8-d469157901d4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:58.784651 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8a14610b-7795-435b-96b8-d469157901d4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:58.785454 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8a14610b-7795-435b-96b8-d469157901d4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:58.785881 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8a14610b-7795-435b-96b8-d469157901d4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:58.802192 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-8a14610b-7795-435b-96b8-d469157901d4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Getting quotas for project 48fbf7b5fd2347789241c7658fd6bb83. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:58:58.806280 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-8a14610b-7795-435b-96b8-d469157901d4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Getting quotas for user 407502700533436dbeaad32a12fb5d90 and project 48fbf7b5fd2347789241c7658fd6bb83. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:58:58.817073 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-8a14610b-7795-435b-96b8-d469157901d4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Going to run 1 instances... {{(pid=122564) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 13:58:58.819498 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-8a14610b-7795-435b-96b8-d469157901d4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: b840c92f-e85f-40e9-8099-55cf13c08561] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='acdb574e-2ba9-4029-849b-377b4d5722ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 13:58:58.863880 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-8a14610b-7795-435b-96b8-d469157901d4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511918 Nov 21 13:58:58.865082 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 493/981] 10.222.0.11 () {60 vars in 1146 bytes} [Sun Nov 21 13:58:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 21 13:58:58.874995 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-b3e93487-2e55-4f00-8cbc-d3e2aed27995 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:58.876197 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-b3e93487-2e55-4f00-8cbc-d3e2aed27995 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: b840c92f-e85f-40e9-8099-55cf13c08561] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:58.933202 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-b3e93487-2e55-4f00-8cbc-d3e2aed27995 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:58:58.940318 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-b3e93487-2e55-4f00-8cbc-d3e2aed27995 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561" status: 200 len: 1217 microversion: 2.1 time: 0.069703 Nov 21 13:58:58.940884 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 489/982] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:58 2021] GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:58:59.957443 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-5c035ae2-0e1c-48fa-a742-a3c0b8efad45 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:58:59.958057 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-5c035ae2-0e1c-48fa-a742-a3c0b8efad45 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: b840c92f-e85f-40e9-8099-55cf13c08561] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:58:59.965137 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5c035ae2-0e1c-48fa-a742-a3c0b8efad45 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:59.965835 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5c035ae2-0e1c-48fa-a742-a3c0b8efad45 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:58:59.966619 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5c035ae2-0e1c-48fa-a742-a3c0b8efad45 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:58:59.967219 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5c035ae2-0e1c-48fa-a742-a3c0b8efad45 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:00.031681 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-5c035ae2-0e1c-48fa-a742-a3c0b8efad45 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:00.039212 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-5c035ae2-0e1c-48fa-a742-a3c0b8efad45 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561" status: 200 len: 1275 microversion: 2.1 time: 0.085871 Nov 21 13:59:00.040104 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 494/983] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:58:59 2021] GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561 => generated 1275 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:01.055939 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-24e3984c-990c-4c3b-b568-933a84c4cb78 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:01.056810 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-24e3984c-990c-4c3b-b568-933a84c4cb78 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: b840c92f-e85f-40e9-8099-55cf13c08561] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:01.064000 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-24e3984c-990c-4c3b-b568-933a84c4cb78 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:01.064738 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-24e3984c-990c-4c3b-b568-933a84c4cb78 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:01.065598 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-24e3984c-990c-4c3b-b568-933a84c4cb78 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:01.066108 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-24e3984c-990c-4c3b-b568-933a84c4cb78 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:01.304109 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-24e3984c-990c-4c3b-b568-933a84c4cb78 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:01.311997 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-24e3984c-990c-4c3b-b568-933a84c4cb78 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561" status: 200 len: 1317 microversion: 2.1 time: 0.259630 Nov 21 13:59:01.312736 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 490/984] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:01 2021] GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561 => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:01.436207 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-d61da6ff-c7a8-4991-a682-ca9091f9e9b8 req-cea78e7f-3d6a-4458-ade4-c51a39d9fad2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b840c92f-e85f-40e9-8099-55cf13c08561", "tag": "0a933a52-1c53-4248-b05b-665a5dce9f5a"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:59:01.440936 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:59:01.440936 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:59:01.460468 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-d61da6ff-c7a8-4991-a682-ca9091f9e9b8 req-cea78e7f-3d6a-4458-ade4-c51a39d9fad2 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:01.460912 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-d61da6ff-c7a8-4991-a682-ca9091f9e9b8 req-cea78e7f-3d6a-4458-ade4-c51a39d9fad2 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:01.472763 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-d61da6ff-c7a8-4991-a682-ca9091f9e9b8 req-cea78e7f-3d6a-4458-ade4-c51a39d9fad2 service nova] Creating event network-changed:0a933a52-1c53-4248-b05b-665a5dce9f5a for instance b840c92f-e85f-40e9-8099-55cf13c08561 on hv-cinder-76845 Nov 21 13:59:01.478193 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-d61da6ff-c7a8-4991-a682-ca9091f9e9b8 req-cea78e7f-3d6a-4458-ade4-c51a39d9fad2 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050248 Nov 21 13:59:01.478918 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 495/985] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:59:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:59:02.328916 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-6d766ee8-c03a-4e42-8f50-4921bfef1ae6 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:02.329560 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-6d766ee8-c03a-4e42-8f50-4921bfef1ae6 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: b840c92f-e85f-40e9-8099-55cf13c08561] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:02.335836 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6d766ee8-c03a-4e42-8f50-4921bfef1ae6 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:02.336361 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6d766ee8-c03a-4e42-8f50-4921bfef1ae6 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:02.337162 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6d766ee8-c03a-4e42-8f50-4921bfef1ae6 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:02.337597 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6d766ee8-c03a-4e42-8f50-4921bfef1ae6 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:02.478095 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-6d766ee8-c03a-4e42-8f50-4921bfef1ae6 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:02.485902 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-6d766ee8-c03a-4e42-8f50-4921bfef1ae6 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561" status: 200 len: 1317 microversion: 2.1 time: 0.161226 Nov 21 13:59:02.486464 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 491/986] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:02 2021] GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:03.503627 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-138d1aea-ca43-48db-a0d6-09febca14e60 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:03.504363 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-138d1aea-ca43-48db-a0d6-09febca14e60 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: b840c92f-e85f-40e9-8099-55cf13c08561] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:03.511082 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-138d1aea-ca43-48db-a0d6-09febca14e60 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:03.511551 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-138d1aea-ca43-48db-a0d6-09febca14e60 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:03.512400 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-138d1aea-ca43-48db-a0d6-09febca14e60 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:03.512905 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-138d1aea-ca43-48db-a0d6-09febca14e60 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:03.665889 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-138d1aea-ca43-48db-a0d6-09febca14e60 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:03.674051 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-138d1aea-ca43-48db-a0d6-09febca14e60 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561" status: 200 len: 1317 microversion: 2.1 time: 0.175107 Nov 21 13:59:03.674851 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 496/987] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:03 2021] GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:04.690678 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-e9281b06-3215-4cfe-9ae8-4f68027f3e69 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:04.691204 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-e9281b06-3215-4cfe-9ae8-4f68027f3e69 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: b840c92f-e85f-40e9-8099-55cf13c08561] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:04.697518 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e9281b06-3215-4cfe-9ae8-4f68027f3e69 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:04.697975 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e9281b06-3215-4cfe-9ae8-4f68027f3e69 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:04.698752 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e9281b06-3215-4cfe-9ae8-4f68027f3e69 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:04.699191 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e9281b06-3215-4cfe-9ae8-4f68027f3e69 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:04.827527 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-e9281b06-3215-4cfe-9ae8-4f68027f3e69 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:04.835719 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-e9281b06-3215-4cfe-9ae8-4f68027f3e69 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561" status: 200 len: 1317 microversion: 2.1 time: 0.148522 Nov 21 13:59:04.836051 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 492/988] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:04 2021] GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:05.532971 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-00a82e5b-b59d-4b1d-866e-a22ab62a97b5 req-9d26886d-4601-4158-941b-de3f4221d2fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b840c92f-e85f-40e9-8099-55cf13c08561", "name": "network-vif-plugged", "status": "completed", "tag": "0a933a52-1c53-4248-b05b-665a5dce9f5a"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:59:05.535292 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:59:05.535292 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:59:05.545462 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-00a82e5b-b59d-4b1d-866e-a22ab62a97b5 req-9d26886d-4601-4158-941b-de3f4221d2fd service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:05.545914 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-00a82e5b-b59d-4b1d-866e-a22ab62a97b5 req-9d26886d-4601-4158-941b-de3f4221d2fd service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:05.558417 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-00a82e5b-b59d-4b1d-866e-a22ab62a97b5 req-9d26886d-4601-4158-941b-de3f4221d2fd service nova] Creating event network-vif-plugged:0a933a52-1c53-4248-b05b-665a5dce9f5a for instance b840c92f-e85f-40e9-8099-55cf13c08561 on hv-cinder-76845 Nov 21 13:59:05.563333 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-00a82e5b-b59d-4b1d-866e-a22ab62a97b5 req-9d26886d-4601-4158-941b-de3f4221d2fd service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034539 Nov 21 13:59:05.563883 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 497/989] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:59:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:59:05.852011 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-7557efaa-4d98-479e-bee1-1a053cd4e0c3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:05.852877 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-7557efaa-4d98-479e-bee1-1a053cd4e0c3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: b840c92f-e85f-40e9-8099-55cf13c08561] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:05.860452 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7557efaa-4d98-479e-bee1-1a053cd4e0c3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:05.860908 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7557efaa-4d98-479e-bee1-1a053cd4e0c3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:05.861707 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7557efaa-4d98-479e-bee1-1a053cd4e0c3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:05.862149 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7557efaa-4d98-479e-bee1-1a053cd4e0c3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:05.996162 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-7557efaa-4d98-479e-bee1-1a053cd4e0c3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:06.003732 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-7557efaa-4d98-479e-bee1-1a053cd4e0c3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561" status: 200 len: 1317 microversion: 2.1 time: 0.155585 Nov 21 13:59:06.004333 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 493/990] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:05 2021] GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:07.022932 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b98aea6e-7c24-4225-a07f-2667cbe7f1e2 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:07.023833 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b98aea6e-7c24-4225-a07f-2667cbe7f1e2 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: b840c92f-e85f-40e9-8099-55cf13c08561] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:07.031229 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b98aea6e-7c24-4225-a07f-2667cbe7f1e2 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:07.031889 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b98aea6e-7c24-4225-a07f-2667cbe7f1e2 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:07.032709 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b98aea6e-7c24-4225-a07f-2667cbe7f1e2 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:07.033201 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b98aea6e-7c24-4225-a07f-2667cbe7f1e2 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:07.181574 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-b98aea6e-7c24-4225-a07f-2667cbe7f1e2 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:07.189268 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-b98aea6e-7c24-4225-a07f-2667cbe7f1e2 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561" status: 200 len: 1317 microversion: 2.1 time: 0.172033 Nov 21 13:59:07.189827 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 498/991] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:07 2021] GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:08.205428 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-f202b9dd-899f-4a57-99fc-a7f98c36993c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:08.206046 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-f202b9dd-899f-4a57-99fc-a7f98c36993c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: b840c92f-e85f-40e9-8099-55cf13c08561] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:08.209765 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-be71c794-92f7-45c6-ac27-8f0255b0a0fc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1820596569", "imageRef": "acdb574e-2ba9-4029-849b-377b4d5722ce", "flavorRef": "452", "networks": [{"uuid": "6f097009-41cb-4ff1-a076-87e9a8cd07fe"}]}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:59:08.212367 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f202b9dd-899f-4a57-99fc-a7f98c36993c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:08.212819 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f202b9dd-899f-4a57-99fc-a7f98c36993c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:08.213602 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f202b9dd-899f-4a57-99fc-a7f98c36993c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:08.214039 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f202b9dd-899f-4a57-99fc-a7f98c36993c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:08.260727 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.network.neutron [None req-be71c794-92f7-45c6-ac27-8f0255b0a0fc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] validate_networks() for [('6f097009-41cb-4ff1-a076-87e9a8cd07fe', None, None, None, None, None)] {{(pid=122564) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 21 13:59:08.344948 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-f202b9dd-899f-4a57-99fc-a7f98c36993c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:08.352339 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-f202b9dd-899f-4a57-99fc-a7f98c36993c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561" status: 200 len: 1507 microversion: 2.1 time: 0.150477 Nov 21 13:59:08.352914 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 494/992] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:08 2021] GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:08.611493 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-be71c794-92f7-45c6-ac27-8f0255b0a0fc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Flavor limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 13:59:08.611958 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-be71c794-92f7-45c6-ac27-8f0255b0a0fc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Image limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 13:59:08.612440 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-be71c794-92f7-45c6-ac27-8f0255b0a0fc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Flavor pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 13:59:08.612853 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-be71c794-92f7-45c6-ac27-8f0255b0a0fc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Image pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 13:59:08.613271 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-be71c794-92f7-45c6-ac27-8f0255b0a0fc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 13:59:08.622179 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-be71c794-92f7-45c6-ac27-8f0255b0a0fc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:08.622637 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-be71c794-92f7-45c6-ac27-8f0255b0a0fc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:08.623726 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-be71c794-92f7-45c6-ac27-8f0255b0a0fc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:08.624226 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-be71c794-92f7-45c6-ac27-8f0255b0a0fc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:08.640804 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-be71c794-92f7-45c6-ac27-8f0255b0a0fc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Getting quotas for project b0b942babf814a7ead64e37a8ded8dff. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 13:59:08.644763 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-be71c794-92f7-45c6-ac27-8f0255b0a0fc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Getting quotas for user feec808a4da948a394aabba9117d7d24 and project b0b942babf814a7ead64e37a8ded8dff. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 13:59:08.655598 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-be71c794-92f7-45c6-ac27-8f0255b0a0fc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Going to run 1 instances... {{(pid=122564) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 13:59:08.658517 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-be71c794-92f7-45c6-ac27-8f0255b0a0fc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 7fdb301a-82fc-4b66-93ed-988cb00b0a58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='acdb574e-2ba9-4029-849b-377b4d5722ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 13:59:08.704571 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-be71c794-92f7-45c6-ac27-8f0255b0a0fc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498386 Nov 21 13:59:08.710434 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 499/993] 10.222.0.11 () {60 vars in 1146 bytes} [Sun Nov 21 13:59:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 13:59:08.716712 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a2305b18-ab3c-4a7d-8332-fa4583b90196 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:08.717534 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a2305b18-ab3c-4a7d-8332-fa4583b90196 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 7fdb301a-82fc-4b66-93ed-988cb00b0a58] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:08.773914 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a2305b18-ab3c-4a7d-8332-fa4583b90196 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:08.780623 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a2305b18-ab3c-4a7d-8332-fa4583b90196 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58" status: 200 len: 1219 microversion: 2.1 time: 0.068062 Nov 21 13:59:08.781172 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 495/994] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:08 2021] GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:09.674732 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-673124ac-ad25-4b04-b01d-c13ecab9088a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d04e499-153b-468c-abd8-a5d2bc15d7b8"}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:59:09.675831 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-673124ac-ad25-4b04-b01d-c13ecab9088a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: b840c92f-e85f-40e9-8099-55cf13c08561] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:09.682739 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-673124ac-ad25-4b04-b01d-c13ecab9088a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:09.683455 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-673124ac-ad25-4b04-b01d-c13ecab9088a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:09.684504 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-673124ac-ad25-4b04-b01d-c13ecab9088a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:09.685112 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-673124ac-ad25-4b04-b01d-c13ecab9088a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:09.798184 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-59ce9d08-6e01-4241-b737-2af7f9010d46 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:09.798870 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-59ce9d08-6e01-4241-b737-2af7f9010d46 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 7fdb301a-82fc-4b66-93ed-988cb00b0a58] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:09.806501 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-59ce9d08-6e01-4241-b737-2af7f9010d46 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:09.807153 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-59ce9d08-6e01-4241-b737-2af7f9010d46 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:09.808748 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-59ce9d08-6e01-4241-b737-2af7f9010d46 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:09.809219 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-59ce9d08-6e01-4241-b737-2af7f9010d46 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:09.944473 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-673124ac-ad25-4b04-b01d-c13ecab9088a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "POST /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274384 Nov 21 13:59:09.945095 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 500/995] 10.222.0.11 () {60 vars in 1322 bytes} [Sun Nov 21 13:59:09 2021] POST /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:59:09.979630 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-59ce9d08-6e01-4241-b737-2af7f9010d46 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:09.987600 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-59ce9d08-6e01-4241-b737-2af7f9010d46 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58" status: 200 len: 1277 microversion: 2.1 time: 0.193649 Nov 21 13:59:09.988435 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 496/996] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:09 2021] GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58 => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 13:59:11.005725 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-bb450b2f-9e00-4dda-b4e6-872d6dd26e30 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:11.006433 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-bb450b2f-9e00-4dda-b4e6-872d6dd26e30 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 7fdb301a-82fc-4b66-93ed-988cb00b0a58] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:11.013022 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bb450b2f-9e00-4dda-b4e6-872d6dd26e30 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:11.013476 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bb450b2f-9e00-4dda-b4e6-872d6dd26e30 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:11.014455 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bb450b2f-9e00-4dda-b4e6-872d6dd26e30 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:11.014892 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-bb450b2f-9e00-4dda-b4e6-872d6dd26e30 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:11.158807 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-bb450b2f-9e00-4dda-b4e6-872d6dd26e30 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:11.166011 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-bb450b2f-9e00-4dda-b4e6-872d6dd26e30 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58" status: 200 len: 1319 microversion: 2.1 time: 0.164443 Nov 21 13:59:11.166576 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 501/997] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:11 2021] GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:11.188857 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-3a5f8c9b-f370-4adf-a2ca-6b0586a2393d req-bd9a5eba-3e5f-4a17-9502-5e20f7b77226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fdb301a-82fc-4b66-93ed-988cb00b0a58", "tag": "8025d2bd-f151-4446-9381-c3834109dabf"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:59:11.190517 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:59:11.190517 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:59:11.198032 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-3a5f8c9b-f370-4adf-a2ca-6b0586a2393d req-bd9a5eba-3e5f-4a17-9502-5e20f7b77226 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:11.208434 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-3a5f8c9b-f370-4adf-a2ca-6b0586a2393d req-bd9a5eba-3e5f-4a17-9502-5e20f7b77226 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:11.220093 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-3a5f8c9b-f370-4adf-a2ca-6b0586a2393d req-bd9a5eba-3e5f-4a17-9502-5e20f7b77226 service nova] Creating event network-changed:8025d2bd-f151-4446-9381-c3834109dabf for instance 7fdb301a-82fc-4b66-93ed-988cb00b0a58 on hv-cinder-76845 Nov 21 13:59:11.225022 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-3a5f8c9b-f370-4adf-a2ca-6b0586a2393d req-bd9a5eba-3e5f-4a17-9502-5e20f7b77226 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040681 Nov 21 13:59:11.225606 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 497/998] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:59:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:59:12.184731 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-f4fe9244-d641-478d-93b4-099e7cf54dbd tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:12.185377 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-f4fe9244-d641-478d-93b4-099e7cf54dbd tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 7fdb301a-82fc-4b66-93ed-988cb00b0a58] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:12.191737 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f4fe9244-d641-478d-93b4-099e7cf54dbd tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:12.192209 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f4fe9244-d641-478d-93b4-099e7cf54dbd tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:12.192990 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f4fe9244-d641-478d-93b4-099e7cf54dbd tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:12.193422 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f4fe9244-d641-478d-93b4-099e7cf54dbd tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:12.325703 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-f4fe9244-d641-478d-93b4-099e7cf54dbd tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:12.333502 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-f4fe9244-d641-478d-93b4-099e7cf54dbd tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58" status: 200 len: 1319 microversion: 2.1 time: 0.152418 Nov 21 13:59:12.334071 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 502/999] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:12 2021] GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:13.351104 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-1de3f84d-0c50-4d63-84d6-51723d20a946 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:13.351826 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-1de3f84d-0c50-4d63-84d6-51723d20a946 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 7fdb301a-82fc-4b66-93ed-988cb00b0a58] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:13.357921 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1de3f84d-0c50-4d63-84d6-51723d20a946 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:13.358375 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1de3f84d-0c50-4d63-84d6-51723d20a946 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:13.359730 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1de3f84d-0c50-4d63-84d6-51723d20a946 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:13.360191 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1de3f84d-0c50-4d63-84d6-51723d20a946 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:13.488717 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-1de3f84d-0c50-4d63-84d6-51723d20a946 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:13.496076 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-1de3f84d-0c50-4d63-84d6-51723d20a946 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58" status: 200 len: 1319 microversion: 2.1 time: 0.149370 Nov 21 13:59:13.496651 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 498/1000] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:13 2021] GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:14.512448 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-56cf1e8c-f00d-473c-9abb-ccdbe9675a5d tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:14.513017 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-56cf1e8c-f00d-473c-9abb-ccdbe9675a5d tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 7fdb301a-82fc-4b66-93ed-988cb00b0a58] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:14.519874 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-56cf1e8c-f00d-473c-9abb-ccdbe9675a5d tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:14.520328 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-56cf1e8c-f00d-473c-9abb-ccdbe9675a5d tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:14.521094 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-56cf1e8c-f00d-473c-9abb-ccdbe9675a5d tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:14.521524 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-56cf1e8c-f00d-473c-9abb-ccdbe9675a5d tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:14.651901 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-56cf1e8c-f00d-473c-9abb-ccdbe9675a5d tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:14.659665 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-56cf1e8c-f00d-473c-9abb-ccdbe9675a5d tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58" status: 200 len: 1319 microversion: 2.1 time: 0.150915 Nov 21 13:59:14.660262 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 503/1001] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:14 2021] GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:15.633710 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-d827fded-9516-46d4-97e7-eb6fe94253c6 req-0ae03109-0fc1-4a79-8723-7f5c78d00fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fdb301a-82fc-4b66-93ed-988cb00b0a58", "name": "network-vif-plugged", "status": "completed", "tag": "8025d2bd-f151-4446-9381-c3834109dabf"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:59:15.635273 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:59:15.635273 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:59:15.643208 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-d827fded-9516-46d4-97e7-eb6fe94253c6 req-0ae03109-0fc1-4a79-8723-7f5c78d00fd1 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:15.643664 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-d827fded-9516-46d4-97e7-eb6fe94253c6 req-0ae03109-0fc1-4a79-8723-7f5c78d00fd1 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:15.654620 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-d827fded-9516-46d4-97e7-eb6fe94253c6 req-0ae03109-0fc1-4a79-8723-7f5c78d00fd1 service nova] Creating event network-vif-plugged:8025d2bd-f151-4446-9381-c3834109dabf for instance 7fdb301a-82fc-4b66-93ed-988cb00b0a58 on hv-cinder-76845 Nov 21 13:59:15.659921 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-d827fded-9516-46d4-97e7-eb6fe94253c6 req-0ae03109-0fc1-4a79-8723-7f5c78d00fd1 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030712 Nov 21 13:59:15.660512 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 499/1002] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:59:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:59:15.676341 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-0fe91c7b-5ca4-45e7-98b0-a1c914f6977a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:15.677197 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-0fe91c7b-5ca4-45e7-98b0-a1c914f6977a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 7fdb301a-82fc-4b66-93ed-988cb00b0a58] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:15.684095 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0fe91c7b-5ca4-45e7-98b0-a1c914f6977a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:15.684638 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0fe91c7b-5ca4-45e7-98b0-a1c914f6977a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:15.685522 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0fe91c7b-5ca4-45e7-98b0-a1c914f6977a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:15.686312 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0fe91c7b-5ca4-45e7-98b0-a1c914f6977a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:15.819483 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-0fe91c7b-5ca4-45e7-98b0-a1c914f6977a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:15.827165 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-0fe91c7b-5ca4-45e7-98b0-a1c914f6977a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58" status: 200 len: 1319 microversion: 2.1 time: 0.154378 Nov 21 13:59:15.828409 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 504/1003] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:15 2021] GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:16.846576 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c2cc20d2-1e84-4edc-9565-f84814303945 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:16.847297 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-c2cc20d2-1e84-4edc-9565-f84814303945 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 7fdb301a-82fc-4b66-93ed-988cb00b0a58] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:16.853347 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c2cc20d2-1e84-4edc-9565-f84814303945 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:16.853794 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c2cc20d2-1e84-4edc-9565-f84814303945 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:16.854560 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c2cc20d2-1e84-4edc-9565-f84814303945 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:16.854994 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c2cc20d2-1e84-4edc-9565-f84814303945 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:16.989141 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-c2cc20d2-1e84-4edc-9565-f84814303945 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:16.996356 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c2cc20d2-1e84-4edc-9565-f84814303945 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58" status: 200 len: 1319 microversion: 2.1 time: 0.154840 Nov 21 13:59:16.996924 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 500/1004] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:16 2021] GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:17.500202 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b4d05dfc-739d-4785-bf00-457258457ab4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:17.500674 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b4d05dfc-739d-4785-bf00-457258457ab4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: b840c92f-e85f-40e9-8099-55cf13c08561] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:17.506838 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b4d05dfc-739d-4785-bf00-457258457ab4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:17.507295 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b4d05dfc-739d-4785-bf00-457258457ab4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:17.508111 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b4d05dfc-739d-4785-bf00-457258457ab4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:17.508547 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b4d05dfc-739d-4785-bf00-457258457ab4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:17.588453 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.objects.instance [None req-b4d05dfc-739d-4785-bf00-457258457ab4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lazy-loading 'services' on Instance uuid b840c92f-e85f-40e9-8099-55cf13c08561 {{(pid=122564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:59:17.657092 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-b4d05dfc-739d-4785-bf00-457258457ab4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "DELETE /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561/os-volume_attachments/9d04e499-153b-468c-abd8-a5d2bc15d7b8" status: 202 len: 0 microversion: 2.1 time: 0.161320 Nov 21 13:59:17.657683 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 505/1005] 10.222.0.11 () {58 vars in 1415 bytes} [Sun Nov 21 13:59:17 2021] DELETE /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561/os-volume_attachments/9d04e499-153b-468c-abd8-a5d2bc15d7b8 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:59:17.665838 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-151524fe-e703-4814-b938-ed94143e8f7f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:17.666755 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-151524fe-e703-4814-b938-ed94143e8f7f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: b840c92f-e85f-40e9-8099-55cf13c08561] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:17.673192 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-151524fe-e703-4814-b938-ed94143e8f7f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:17.673652 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-151524fe-e703-4814-b938-ed94143e8f7f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:17.674539 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-151524fe-e703-4814-b938-ed94143e8f7f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:17.674997 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-151524fe-e703-4814-b938-ed94143e8f7f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:17.705213 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-151524fe-e703-4814-b938-ed94143e8f7f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043127 Nov 21 13:59:17.705924 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 501/1006] 10.222.0.11 () {58 vars in 1301 bytes} [Sun Nov 21 13:59:17 2021] GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:59:18.013924 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-c7b3226d-8673-43d2-af0f-f31dfa553358 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:18.014498 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-c7b3226d-8673-43d2-af0f-f31dfa553358 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 7fdb301a-82fc-4b66-93ed-988cb00b0a58] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:18.020655 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c7b3226d-8673-43d2-af0f-f31dfa553358 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:18.021108 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c7b3226d-8673-43d2-af0f-f31dfa553358 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:18.021892 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c7b3226d-8673-43d2-af0f-f31dfa553358 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:18.022331 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c7b3226d-8673-43d2-af0f-f31dfa553358 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:18.148692 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-c7b3226d-8673-43d2-af0f-f31dfa553358 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:18.155960 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-c7b3226d-8673-43d2-af0f-f31dfa553358 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58" status: 200 len: 1508 microversion: 2.1 time: 0.146212 Nov 21 13:59:18.156567 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 506/1007] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:18 2021] GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:18.717270 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ed05d59d-8b62-4685-943f-46aa472a2372 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:18.718293 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ed05d59d-8b62-4685-943f-46aa472a2372 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: b840c92f-e85f-40e9-8099-55cf13c08561] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:18.725805 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ed05d59d-8b62-4685-943f-46aa472a2372 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:18.725985 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ed05d59d-8b62-4685-943f-46aa472a2372 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:18.726791 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ed05d59d-8b62-4685-943f-46aa472a2372 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:18.727098 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ed05d59d-8b62-4685-943f-46aa472a2372 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:18.756715 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ed05d59d-8b62-4685-943f-46aa472a2372 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043221 Nov 21 13:59:18.757295 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 502/1008] 10.222.0.11 () {58 vars in 1301 bytes} [Sun Nov 21 13:59:18 2021] GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 13:59:19.939196 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-360c22b7-d53a-4726-be13-18fcfb48afa4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:19.939676 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-360c22b7-d53a-4726-be13-18fcfb48afa4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: b840c92f-e85f-40e9-8099-55cf13c08561] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:19.945498 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-360c22b7-d53a-4726-be13-18fcfb48afa4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:19.945945 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-360c22b7-d53a-4726-be13-18fcfb48afa4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:19.946712 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-360c22b7-d53a-4726-be13-18fcfb48afa4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:19.947177 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-360c22b7-d53a-4726-be13-18fcfb48afa4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:19.975451 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-360c22b7-d53a-4726-be13-18fcfb48afa4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: b840c92f-e85f-40e9-8099-55cf13c08561] Going to try to terminate instance {{(pid=122564) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 21 13:59:20.053410 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-360c22b7-d53a-4726-be13-18fcfb48afa4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "DELETE /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561" status: 204 len: 0 microversion: 2.1 time: 0.117920 Nov 21 13:59:20.053984 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 507/1009] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 13:59:19 2021] DELETE /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 13:59:20.062160 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-36e50789-a03f-4c17-8301-b1469701043a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:20.063286 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-36e50789-a03f-4c17-8301-b1469701043a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: b840c92f-e85f-40e9-8099-55cf13c08561] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:20.069604 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-36e50789-a03f-4c17-8301-b1469701043a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:20.070054 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-36e50789-a03f-4c17-8301-b1469701043a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:20.070836 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-36e50789-a03f-4c17-8301-b1469701043a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:20.071277 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-36e50789-a03f-4c17-8301-b1469701043a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:20.202948 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-36e50789-a03f-4c17-8301-b1469701043a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:20.210419 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-36e50789-a03f-4c17-8301-b1469701043a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561" status: 200 len: 1513 microversion: 2.1 time: 0.151956 Nov 21 13:59:20.210986 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 503/1010] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:20 2021] GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:21.227520 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-46e2cf3b-36f4-4fc9-8392-b21136bb82ae tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:21.228343 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-46e2cf3b-36f4-4fc9-8392-b21136bb82ae tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: b840c92f-e85f-40e9-8099-55cf13c08561] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:21.234619 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-46e2cf3b-36f4-4fc9-8392-b21136bb82ae tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:21.235103 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-46e2cf3b-36f4-4fc9-8392-b21136bb82ae tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:21.236613 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-46e2cf3b-36f4-4fc9-8392-b21136bb82ae tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:21.237051 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-46e2cf3b-36f4-4fc9-8392-b21136bb82ae tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:21.370727 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-46e2cf3b-36f4-4fc9-8392-b21136bb82ae tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:21.378280 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-46e2cf3b-36f4-4fc9-8392-b21136bb82ae tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561" status: 200 len: 1513 microversion: 2.1 time: 0.155055 Nov 21 13:59:21.378839 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 508/1011] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:21 2021] GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:22.340644 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-27f96070-4296-4071-92f7-63ad58cdb103 req-81c0575a-93a8-46f8-bff5-e33901908fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b840c92f-e85f-40e9-8099-55cf13c08561", "name": "network-vif-deleted", "tag": "0a933a52-1c53-4248-b05b-665a5dce9f5a"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:59:22.342603 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:59:22.342603 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:59:22.351622 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-27f96070-4296-4071-92f7-63ad58cdb103 req-81c0575a-93a8-46f8-bff5-e33901908fa6 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:22.362071 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-27f96070-4296-4071-92f7-63ad58cdb103 req-81c0575a-93a8-46f8-bff5-e33901908fa6 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:22.375106 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-27f96070-4296-4071-92f7-63ad58cdb103 req-81c0575a-93a8-46f8-bff5-e33901908fa6 service nova] Creating event network-vif-deleted:0a933a52-1c53-4248-b05b-665a5dce9f5a for instance b840c92f-e85f-40e9-8099-55cf13c08561 on hv-cinder-76845 Nov 21 13:59:22.380001 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-27f96070-4296-4071-92f7-63ad58cdb103 req-81c0575a-93a8-46f8-bff5-e33901908fa6 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043220 Nov 21 13:59:22.380606 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 504/1012] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:59:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:59:22.394917 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-120f59a8-d69d-4904-be04-611e94b1a96b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:22.396177 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-120f59a8-d69d-4904-be04-611e94b1a96b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: b840c92f-e85f-40e9-8099-55cf13c08561] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:22.407926 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-120f59a8-d69d-4904-be04-611e94b1a96b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:22.409291 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-120f59a8-d69d-4904-be04-611e94b1a96b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:22.410217 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-120f59a8-d69d-4904-be04-611e94b1a96b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:22.410900 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-120f59a8-d69d-4904-be04-611e94b1a96b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:22.481234 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-120f59a8-d69d-4904-be04-611e94b1a96b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:22.489647 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-120f59a8-d69d-4904-be04-611e94b1a96b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561" status: 200 len: 1302 microversion: 2.1 time: 0.098940 Nov 21 13:59:22.490224 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 509/1013] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:22 2021] GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561 => generated 1302 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:23.507864 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a412d10b-13d0-4619-a53c-7b0050191fb5 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:23.508599 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a412d10b-13d0-4619-a53c-7b0050191fb5 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: b840c92f-e85f-40e9-8099-55cf13c08561] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:23.515069 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a412d10b-13d0-4619-a53c-7b0050191fb5 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:23.515518 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a412d10b-13d0-4619-a53c-7b0050191fb5 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:23.516337 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a412d10b-13d0-4619-a53c-7b0050191fb5 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:23.517433 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a412d10b-13d0-4619-a53c-7b0050191fb5 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:23.530115 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-a412d10b-13d0-4619-a53c-7b0050191fb5 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] HTTP exception thrown: Instance b840c92f-e85f-40e9-8099-55cf13c08561 could not be found. Nov 21 13:59:23.530693 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a412d10b-13d0-4619-a53c-7b0050191fb5 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Returning 404 to user: Instance b840c92f-e85f-40e9-8099-55cf13c08561 could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:59:23.531499 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a412d10b-13d0-4619-a53c-7b0050191fb5 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561" status: 404 len: 111 microversion: 2.1 time: 0.027982 Nov 21 13:59:23.532070 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 505/1014] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:23 2021] GET /compute/v2.1/servers/b840c92f-e85f-40e9-8099-55cf13c08561 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:59:24.658794 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-5afbf431-07eb-47fb-a208-b95fc65232a7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:24.659298 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-5afbf431-07eb-47fb-a208-b95fc65232a7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 31a3c09e-663c-428c-8203-cb337ece6c85] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:24.665662 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5afbf431-07eb-47fb-a208-b95fc65232a7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:24.666105 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5afbf431-07eb-47fb-a208-b95fc65232a7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:24.666879 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5afbf431-07eb-47fb-a208-b95fc65232a7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:24.667315 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5afbf431-07eb-47fb-a208-b95fc65232a7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:24.842965 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-5afbf431-07eb-47fb-a208-b95fc65232a7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 31a3c09e-663c-428c-8203-cb337ece6c85] Going to try to terminate instance {{(pid=122564) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 21 13:59:24.917554 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-5afbf431-07eb-47fb-a208-b95fc65232a7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "DELETE /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85" status: 204 len: 0 microversion: 2.1 time: 0.262127 Nov 21 13:59:24.918294 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 510/1015] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 13:59:24 2021] DELETE /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 13:59:24.927016 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-3cbe1aeb-4499-46ce-aa6a-6b7e23b908d0 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:24.927637 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-3cbe1aeb-4499-46ce-aa6a-6b7e23b908d0 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 31a3c09e-663c-428c-8203-cb337ece6c85] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:24.933934 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3cbe1aeb-4499-46ce-aa6a-6b7e23b908d0 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:24.934379 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3cbe1aeb-4499-46ce-aa6a-6b7e23b908d0 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:24.935181 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3cbe1aeb-4499-46ce-aa6a-6b7e23b908d0 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:24.935610 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3cbe1aeb-4499-46ce-aa6a-6b7e23b908d0 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:25.069201 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-3cbe1aeb-4499-46ce-aa6a-6b7e23b908d0 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:25.076493 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-3cbe1aeb-4499-46ce-aa6a-6b7e23b908d0 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85" status: 200 len: 1513 microversion: 2.1 time: 0.154151 Nov 21 13:59:25.077262 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 506/1016] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:24 2021] GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:26.094366 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ecce002f-afab-45fd-bda4-94698fda2490 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:26.094980 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ecce002f-afab-45fd-bda4-94698fda2490 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 31a3c09e-663c-428c-8203-cb337ece6c85] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:26.101869 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ecce002f-afab-45fd-bda4-94698fda2490 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:26.102319 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ecce002f-afab-45fd-bda4-94698fda2490 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:26.103097 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ecce002f-afab-45fd-bda4-94698fda2490 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:26.103532 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ecce002f-afab-45fd-bda4-94698fda2490 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:26.232760 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-ecce002f-afab-45fd-bda4-94698fda2490 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:26.240602 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ecce002f-afab-45fd-bda4-94698fda2490 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85" status: 200 len: 1513 microversion: 2.1 time: 0.150339 Nov 21 13:59:26.241157 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 511/1017] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:26 2021] GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:27.161681 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-50baca0b-19c7-4b9f-93a8-bbbf52c2acd9 req-f5818e6e-97ea-4db0-828b-117976478caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a3c09e-663c-428c-8203-cb337ece6c85", "name": "network-vif-deleted", "tag": "88b1ce6e-bceb-48d2-9c83-267045746fd4"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:59:27.163255 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:59:27.163255 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:59:27.172427 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-50baca0b-19c7-4b9f-93a8-bbbf52c2acd9 req-f5818e6e-97ea-4db0-828b-117976478caa service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:27.172924 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-50baca0b-19c7-4b9f-93a8-bbbf52c2acd9 req-f5818e6e-97ea-4db0-828b-117976478caa service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:27.186884 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-50baca0b-19c7-4b9f-93a8-bbbf52c2acd9 req-f5818e6e-97ea-4db0-828b-117976478caa service nova] Creating event network-vif-deleted:88b1ce6e-bceb-48d2-9c83-267045746fd4 for instance 31a3c09e-663c-428c-8203-cb337ece6c85 on hv-cinder-76845 Nov 21 13:59:27.193571 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-50baca0b-19c7-4b9f-93a8-bbbf52c2acd9 req-f5818e6e-97ea-4db0-828b-117976478caa service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036490 Nov 21 13:59:27.195021 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 507/1018] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:59:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:59:27.260519 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-3e66f54e-e69c-46fb-bbfc-46c57d0f6499 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:27.261299 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3e66f54e-e69c-46fb-bbfc-46c57d0f6499 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 31a3c09e-663c-428c-8203-cb337ece6c85] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:27.268568 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3e66f54e-e69c-46fb-bbfc-46c57d0f6499 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:27.269174 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3e66f54e-e69c-46fb-bbfc-46c57d0f6499 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:27.270078 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3e66f54e-e69c-46fb-bbfc-46c57d0f6499 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:27.270620 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3e66f54e-e69c-46fb-bbfc-46c57d0f6499 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:27.319290 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3e66f54e-e69c-46fb-bbfc-46c57d0f6499 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:27.319768 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3e66f54e-e69c-46fb-bbfc-46c57d0f6499 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:27.320434 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.objects.instance [None req-3e66f54e-e69c-46fb-bbfc-46c57d0f6499 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lazy-loading 'fault' on Instance uuid 31a3c09e-663c-428c-8203-cb337ece6c85 {{(pid=122564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:59:27.368363 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-3e66f54e-e69c-46fb-bbfc-46c57d0f6499 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:27.376159 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-3e66f54e-e69c-46fb-bbfc-46c57d0f6499 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85" status: 200 len: 1307 microversion: 2.1 time: 0.121449 Nov 21 13:59:27.376738 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 512/1019] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:27 2021] GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85 => generated 1307 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:28.395981 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-8a54068d-bd1a-4902-a16b-78462f027da2 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:28.396805 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-8a54068d-bd1a-4902-a16b-78462f027da2 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 31a3c09e-663c-428c-8203-cb337ece6c85] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:28.403653 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8a54068d-bd1a-4902-a16b-78462f027da2 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:28.404201 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8a54068d-bd1a-4902-a16b-78462f027da2 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:28.404987 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8a54068d-bd1a-4902-a16b-78462f027da2 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:28.405427 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8a54068d-bd1a-4902-a16b-78462f027da2 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:28.419449 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-8a54068d-bd1a-4902-a16b-78462f027da2 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] HTTP exception thrown: Instance 31a3c09e-663c-428c-8203-cb337ece6c85 could not be found. Nov 21 13:59:28.420059 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-8a54068d-bd1a-4902-a16b-78462f027da2 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Returning 404 to user: Instance 31a3c09e-663c-428c-8203-cb337ece6c85 could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:59:28.420883 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-8a54068d-bd1a-4902-a16b-78462f027da2 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85" status: 404 len: 111 microversion: 2.1 time: 0.030106 Nov 21 13:59:28.421425 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 508/1020] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:28 2021] GET /compute/v2.1/servers/31a3c09e-663c-428c-8203-cb337ece6c85 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:59:28.429129 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-4e381432-aef2-46b9-99e2-7ce099a5ee2a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:28.429651 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-4e381432-aef2-46b9-99e2-7ce099a5ee2a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 23e6a833-20e6-4882-89ae-bd33ce5e4b48] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:28.435792 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4e381432-aef2-46b9-99e2-7ce099a5ee2a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:28.436341 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4e381432-aef2-46b9-99e2-7ce099a5ee2a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:28.437112 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4e381432-aef2-46b9-99e2-7ce099a5ee2a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:28.437541 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-4e381432-aef2-46b9-99e2-7ce099a5ee2a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:28.461563 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-4e381432-aef2-46b9-99e2-7ce099a5ee2a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 23e6a833-20e6-4882-89ae-bd33ce5e4b48] Going to try to terminate instance {{(pid=122564) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 21 13:59:28.552232 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-4e381432-aef2-46b9-99e2-7ce099a5ee2a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "DELETE /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48" status: 204 len: 0 microversion: 2.1 time: 0.126261 Nov 21 13:59:28.552992 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 513/1021] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 13:59:28 2021] DELETE /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 13:59:28.561318 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-7bceb826-0eb2-4e84-a516-074a01b426af tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:28.561925 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-7bceb826-0eb2-4e84-a516-074a01b426af tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 23e6a833-20e6-4882-89ae-bd33ce5e4b48] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:28.567937 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7bceb826-0eb2-4e84-a516-074a01b426af tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:28.568382 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7bceb826-0eb2-4e84-a516-074a01b426af tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:28.569156 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7bceb826-0eb2-4e84-a516-074a01b426af tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:28.569588 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7bceb826-0eb2-4e84-a516-074a01b426af tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:28.704045 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-7bceb826-0eb2-4e84-a516-074a01b426af tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:28.711859 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-7bceb826-0eb2-4e84-a516-074a01b426af tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48" status: 200 len: 1514 microversion: 2.1 time: 0.154295 Nov 21 13:59:28.712430 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 509/1022] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:28 2021] GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:29.730615 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-46be6470-00b1-42e2-8ef5-b90e6f8cfcf6 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:29.731255 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-46be6470-00b1-42e2-8ef5-b90e6f8cfcf6 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 23e6a833-20e6-4882-89ae-bd33ce5e4b48] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:29.738335 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-46be6470-00b1-42e2-8ef5-b90e6f8cfcf6 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:29.738796 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-46be6470-00b1-42e2-8ef5-b90e6f8cfcf6 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:29.739603 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-46be6470-00b1-42e2-8ef5-b90e6f8cfcf6 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:29.740081 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-46be6470-00b1-42e2-8ef5-b90e6f8cfcf6 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:29.871175 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-46be6470-00b1-42e2-8ef5-b90e6f8cfcf6 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:29.880214 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-46be6470-00b1-42e2-8ef5-b90e6f8cfcf6 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48" status: 200 len: 1514 microversion: 2.1 time: 0.154364 Nov 21 13:59:29.880770 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 514/1023] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:29 2021] GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:30.516614 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-b8df63bc-0c3b-4cae-8619-b80e9d3816a2 req-dd185b1b-94f6-4bb4-a831-21488574c6c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23e6a833-20e6-4882-89ae-bd33ce5e4b48", "name": "network-vif-deleted", "tag": "cee3a926-deeb-40c7-8cda-e34f3786308a"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:59:30.518367 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:59:30.518367 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 13:59:30.526240 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-b8df63bc-0c3b-4cae-8619-b80e9d3816a2 req-dd185b1b-94f6-4bb4-a831-21488574c6c9 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:30.526647 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-b8df63bc-0c3b-4cae-8619-b80e9d3816a2 req-dd185b1b-94f6-4bb4-a831-21488574c6c9 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:30.549313 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-b8df63bc-0c3b-4cae-8619-b80e9d3816a2 req-dd185b1b-94f6-4bb4-a831-21488574c6c9 service nova] Creating event network-vif-deleted:cee3a926-deeb-40c7-8cda-e34f3786308a for instance 23e6a833-20e6-4882-89ae-bd33ce5e4b48 on hv-cinder-76845 Nov 21 13:59:30.555931 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-b8df63bc-0c3b-4cae-8619-b80e9d3816a2 req-dd185b1b-94f6-4bb4-a831-21488574c6c9 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042868 Nov 21 13:59:30.556550 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 510/1024] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:59:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:59:30.897634 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-97569fbd-e095-42dc-8be4-36eca6c6d608 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:30.898167 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-97569fbd-e095-42dc-8be4-36eca6c6d608 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 23e6a833-20e6-4882-89ae-bd33ce5e4b48] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:30.906530 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-97569fbd-e095-42dc-8be4-36eca6c6d608 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:30.907353 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-97569fbd-e095-42dc-8be4-36eca6c6d608 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:30.908921 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-97569fbd-e095-42dc-8be4-36eca6c6d608 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:30.909361 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-97569fbd-e095-42dc-8be4-36eca6c6d608 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:30.945467 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-97569fbd-e095-42dc-8be4-36eca6c6d608 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:30.945919 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-97569fbd-e095-42dc-8be4-36eca6c6d608 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:30.946361 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.objects.instance [None req-97569fbd-e095-42dc-8be4-36eca6c6d608 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lazy-loading 'fault' on Instance uuid 23e6a833-20e6-4882-89ae-bd33ce5e4b48 {{(pid=122564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:59:30.987176 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-97569fbd-e095-42dc-8be4-36eca6c6d608 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:30.994476 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-97569fbd-e095-42dc-8be4-36eca6c6d608 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48" status: 200 len: 1307 microversion: 2.1 time: 0.100817 Nov 21 13:59:30.995087 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 515/1025] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:30 2021] GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48 => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:32.013252 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-74927077-f54b-488a-a341-51d0a66d201d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:32.013968 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-74927077-f54b-488a-a341-51d0a66d201d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 23e6a833-20e6-4882-89ae-bd33ce5e4b48] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:32.020708 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-74927077-f54b-488a-a341-51d0a66d201d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:32.021161 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-74927077-f54b-488a-a341-51d0a66d201d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:32.021939 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-74927077-f54b-488a-a341-51d0a66d201d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:32.022377 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-74927077-f54b-488a-a341-51d0a66d201d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:32.034959 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-74927077-f54b-488a-a341-51d0a66d201d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] HTTP exception thrown: Instance 23e6a833-20e6-4882-89ae-bd33ce5e4b48 could not be found. Nov 21 13:59:32.035536 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-74927077-f54b-488a-a341-51d0a66d201d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Returning 404 to user: Instance 23e6a833-20e6-4882-89ae-bd33ce5e4b48 could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:59:32.036374 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-74927077-f54b-488a-a341-51d0a66d201d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48" status: 404 len: 111 microversion: 2.1 time: 0.027773 Nov 21 13:59:32.036896 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 511/1026] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:32 2021] GET /compute/v2.1/servers/23e6a833-20e6-4882-89ae-bd33ce5e4b48 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:59:33.168696 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2fae8199-979c-4645-8042-d6712b65ffb4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:33.169256 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-2fae8199-979c-4645-8042-d6712b65ffb4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:33.175559 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2fae8199-979c-4645-8042-d6712b65ffb4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:33.176046 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2fae8199-979c-4645-8042-d6712b65ffb4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:33.176843 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2fae8199-979c-4645-8042-d6712b65ffb4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:33.177282 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2fae8199-979c-4645-8042-d6712b65ffb4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:33.201913 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-2fae8199-979c-4645-8042-d6712b65ffb4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e] Going to try to terminate instance {{(pid=122564) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 21 13:59:33.273825 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-2fae8199-979c-4645-8042-d6712b65ffb4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "DELETE /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e" status: 204 len: 0 microversion: 2.1 time: 0.116208 Nov 21 13:59:33.278068 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 516/1027] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 13:59:33 2021] DELETE /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 13:59:33.282987 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-581f8c7e-3f39-4c6f-adbf-10ac8534ddf7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:33.287920 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-581f8c7e-3f39-4c6f-adbf-10ac8534ddf7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:33.293893 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-581f8c7e-3f39-4c6f-adbf-10ac8534ddf7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:33.294352 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-581f8c7e-3f39-4c6f-adbf-10ac8534ddf7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:33.295140 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-581f8c7e-3f39-4c6f-adbf-10ac8534ddf7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:33.295575 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-581f8c7e-3f39-4c6f-adbf-10ac8534ddf7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:33.422483 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-581f8c7e-3f39-4c6f-adbf-10ac8534ddf7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:33.429793 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-581f8c7e-3f39-4c6f-adbf-10ac8534ddf7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e" status: 200 len: 1514 microversion: 2.1 time: 0.150644 Nov 21 13:59:33.430355 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 512/1028] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:33 2021] GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:34.447173 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-c3c00bff-1e8e-4ae4-8372-3606f97ea365 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:34.447891 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-c3c00bff-1e8e-4ae4-8372-3606f97ea365 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:34.454052 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c3c00bff-1e8e-4ae4-8372-3606f97ea365 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:34.454500 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c3c00bff-1e8e-4ae4-8372-3606f97ea365 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:34.455272 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c3c00bff-1e8e-4ae4-8372-3606f97ea365 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:34.455705 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c3c00bff-1e8e-4ae4-8372-3606f97ea365 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:34.585209 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-c3c00bff-1e8e-4ae4-8372-3606f97ea365 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:34.592494 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-c3c00bff-1e8e-4ae4-8372-3606f97ea365 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e" status: 200 len: 1514 microversion: 2.1 time: 0.149267 Nov 21 13:59:34.593083 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 517/1029] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:34 2021] GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:35.306994 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-04b05894-0097-43d9-ac65-2c2b22e691dc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "720adda3-e640-402d-9fc3-b29556f692c3", "device": "/dev/sdb"}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:59:35.308628 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-04b05894-0097-43d9-ac65-2c2b22e691dc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 7fdb301a-82fc-4b66-93ed-988cb00b0a58] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:35.315347 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-04b05894-0097-43d9-ac65-2c2b22e691dc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:35.315795 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-04b05894-0097-43d9-ac65-2c2b22e691dc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:35.316599 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-04b05894-0097-43d9-ac65-2c2b22e691dc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:35.317029 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-04b05894-0097-43d9-ac65-2c2b22e691dc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:35.547446 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-c8d7bf56-106f-44ab-8228-b90caeeb051e req-d5c55889-34bf-494c-97c1-3cf6f79efb95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f927cd1-a768-4be7-9ed5-6ea5ee46da8e", "name": "network-vif-deleted", "tag": "311b993c-d963-4bbd-9dd2-91f64ff1d918"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:59:35.549882 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 13:59:35.549882 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 13:59:35.557593 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-c8d7bf56-106f-44ab-8228-b90caeeb051e req-d5c55889-34bf-494c-97c1-3cf6f79efb95 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:35.558054 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-c8d7bf56-106f-44ab-8228-b90caeeb051e req-d5c55889-34bf-494c-97c1-3cf6f79efb95 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:35.559507 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-04b05894-0097-43d9-ac65-2c2b22e691dc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "POST /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255936 Nov 21 13:59:35.565117 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 513/1030] 10.222.0.11 () {60 vars in 1322 bytes} [Sun Nov 21 13:59:35 2021] POST /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:59:35.571004 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-c8d7bf56-106f-44ab-8228-b90caeeb051e req-d5c55889-34bf-494c-97c1-3cf6f79efb95 service nova] Creating event network-vif-deleted:311b993c-d963-4bbd-9dd2-91f64ff1d918 for instance 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e on hv-cinder-76845 Nov 21 13:59:35.576405 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-c8d7bf56-106f-44ab-8228-b90caeeb051e req-d5c55889-34bf-494c-97c1-3cf6f79efb95 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032702 Nov 21 13:59:35.577326 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 518/1031] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 13:59:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:59:35.610643 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-979e9709-533e-43ed-8a87-94402b41bde7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:35.611423 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-979e9709-533e-43ed-8a87-94402b41bde7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:35.617929 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-979e9709-533e-43ed-8a87-94402b41bde7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:35.618508 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-979e9709-533e-43ed-8a87-94402b41bde7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:35.619476 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-979e9709-533e-43ed-8a87-94402b41bde7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:35.620093 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-979e9709-533e-43ed-8a87-94402b41bde7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:35.687201 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-979e9709-533e-43ed-8a87-94402b41bde7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407502700533436dbeaad32a12fb5d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48fbf7b5fd2347789241c7658fd6bb83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:35.694594 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-979e9709-533e-43ed-8a87-94402b41bde7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e" status: 200 len: 1303 microversion: 2.1 time: 0.088623 Nov 21 13:59:35.695191 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 514/1032] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:35 2021] GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e => generated 1303 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 13:59:36.712155 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ecb127b5-cd66-4965-aab0-ae1dd9145c38 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:36.712859 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ecb127b5-cd66-4965-aab0-ae1dd9145c38 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] [instance: 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:36.718975 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ecb127b5-cd66-4965-aab0-ae1dd9145c38 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:36.719430 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ecb127b5-cd66-4965-aab0-ae1dd9145c38 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:36.720849 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ecb127b5-cd66-4965-aab0-ae1dd9145c38 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:36.721292 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ecb127b5-cd66-4965-aab0-ae1dd9145c38 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:36.734026 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.wsgi [None req-ecb127b5-cd66-4965-aab0-ae1dd9145c38 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] HTTP exception thrown: Instance 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e could not be found. Nov 21 13:59:36.734612 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ecb127b5-cd66-4965-aab0-ae1dd9145c38 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Returning 404 to user: Instance 8f927cd1-a768-4be7-9ed5-6ea5ee46da8e could not be found. {{(pid=122564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:59:36.735424 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ecb127b5-cd66-4965-aab0-ae1dd9145c38 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e" status: 404 len: 111 microversion: 2.1 time: 0.027745 Nov 21 13:59:36.735979 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 519/1033] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:36 2021] GET /compute/v2.1/servers/8f927cd1-a768-4be7-9ed5-6ea5ee46da8e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:59:38.254943 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-8678c409-c691-41af-a893-c2f526a09b08 tempest-VolumesGetTestJSON-1092944011 tempest-VolumesGetTestJSON-1092944011-project] Action: 'create', calling method: .version_select at 0x7fd513478af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-673496869", "metadata": {"Type": "work"}}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 13:59:38.522372 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-8678c409-c691-41af-a893-c2f526a09b08 tempest-VolumesGetTestJSON-1092944011 tempest-VolumesGetTestJSON-1092944011-project] 10.222.0.11 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.376023 Nov 21 13:59:38.523120 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 515/1034] 10.222.0.11 () {60 vars in 1155 bytes} [Sun Nov 21 13:59:38 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 377 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 21 13:59:38.534273 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-8be38e4f-2825-4ff8-b522-e3537d9b82c4 tempest-VolumesGetTestJSON-1092944011 tempest-VolumesGetTestJSON-1092944011-project] Calling method '.version_select at 0x7fd513b733a0>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:38.582280 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-8be38e4f-2825-4ff8-b522-e3537d9b82c4 tempest-VolumesGetTestJSON-1092944011 tempest-VolumesGetTestJSON-1092944011-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/dc3377f2-dde6-4d6e-a806-ffe2cfd35e80" status: 200 len: 352 microversion: 2.1 time: 0.052283 Nov 21 13:59:38.582851 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 520/1035] 10.222.0.11 () {58 vars in 1244 bytes} [Sun Nov 21 13:59:38 2021] GET /compute/v2.1/os-volumes/dc3377f2-dde6-4d6e-a806-ffe2cfd35e80 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:59:39.594033 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-47fe3962-706b-42f4-aab9-3dc1349cace3 tempest-VolumesGetTestJSON-1092944011 tempest-VolumesGetTestJSON-1092944011-project] Calling method '.version_select at 0x7fd5133da3a0>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:39.638830 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-47fe3962-706b-42f4-aab9-3dc1349cace3 tempest-VolumesGetTestJSON-1092944011 tempest-VolumesGetTestJSON-1092944011-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/dc3377f2-dde6-4d6e-a806-ffe2cfd35e80" status: 200 len: 353 microversion: 2.1 time: 0.048856 Nov 21 13:59:39.639388 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 516/1036] 10.222.0.11 () {58 vars in 1244 bytes} [Sun Nov 21 13:59:39 2021] GET /compute/v2.1/os-volumes/dc3377f2-dde6-4d6e-a806-ffe2cfd35e80 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:59:39.650625 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-7acead3e-123b-48d0-940a-492e39d33c9e tempest-VolumesGetTestJSON-1092944011 tempest-VolumesGetTestJSON-1092944011-project] Calling method '.version_select at 0x7fd513b6cf70>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:39.696222 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-7acead3e-123b-48d0-940a-492e39d33c9e tempest-VolumesGetTestJSON-1092944011 tempest-VolumesGetTestJSON-1092944011-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/dc3377f2-dde6-4d6e-a806-ffe2cfd35e80" status: 200 len: 353 microversion: 2.1 time: 0.049527 Nov 21 13:59:39.696777 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 521/1037] 10.222.0.11 () {58 vars in 1244 bytes} [Sun Nov 21 13:59:39 2021] GET /compute/v2.1/os-volumes/dc3377f2-dde6-4d6e-a806-ffe2cfd35e80 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 13:59:39.712714 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-1da769c9-6a77-4f12-ba10-621693349528 tempest-VolumesGetTestJSON-1092944011 tempest-VolumesGetTestJSON-1092944011-project] Calling method '.version_select at 0x7fd513433790>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:39.768799 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-1da769c9-6a77-4f12-ba10-621693349528 tempest-VolumesGetTestJSON-1092944011 tempest-VolumesGetTestJSON-1092944011-project] 10.222.0.11 "DELETE /compute/v2.1/os-volumes/dc3377f2-dde6-4d6e-a806-ffe2cfd35e80" status: 202 len: 0 microversion: 2.1 time: 0.059580 Nov 21 13:59:39.769513 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 517/1038] 10.222.0.11 () {58 vars in 1247 bytes} [Sun Nov 21 13:59:39 2021] DELETE /compute/v2.1/os-volumes/dc3377f2-dde6-4d6e-a806-ffe2cfd35e80 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 13:59:39.777258 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-97fee35c-28f4-486e-907e-779211b6bd6d tempest-VolumesGetTestJSON-1092944011 tempest-VolumesGetTestJSON-1092944011-project] Calling method '.version_select at 0x7fd513b3af70>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:39.823921 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-97fee35c-28f4-486e-907e-779211b6bd6d tempest-VolumesGetTestJSON-1092944011 tempest-VolumesGetTestJSON-1092944011-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/dc3377f2-dde6-4d6e-a806-ffe2cfd35e80" status: 200 len: 352 microversion: 2.1 time: 0.050145 Nov 21 13:59:39.824690 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 522/1039] 10.222.0.11 () {58 vars in 1244 bytes} [Sun Nov 21 13:59:39 2021] GET /compute/v2.1/os-volumes/dc3377f2-dde6-4d6e-a806-ffe2cfd35e80 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 13:59:40.836396 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-9cd078e3-b6a4-4184-84bd-66ba3f70e57a tempest-VolumesGetTestJSON-1092944011 tempest-VolumesGetTestJSON-1092944011-project] Calling method '.version_select at 0x7fd513478d30>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:40.861700 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-9cd078e3-b6a4-4184-84bd-66ba3f70e57a tempest-VolumesGetTestJSON-1092944011 tempest-VolumesGetTestJSON-1092944011-project] HTTP exception thrown: Volume dc3377f2-dde6-4d6e-a806-ffe2cfd35e80 could not be found. Nov 21 13:59:40.862300 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-9cd078e3-b6a4-4184-84bd-66ba3f70e57a tempest-VolumesGetTestJSON-1092944011 tempest-VolumesGetTestJSON-1092944011-project] Returning 404 to user: Volume dc3377f2-dde6-4d6e-a806-ffe2cfd35e80 could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 13:59:40.863120 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-9cd078e3-b6a4-4184-84bd-66ba3f70e57a tempest-VolumesGetTestJSON-1092944011 tempest-VolumesGetTestJSON-1092944011-project] 10.222.0.11 "GET /compute/v2.1/os-volumes/dc3377f2-dde6-4d6e-a806-ffe2cfd35e80" status: 404 len: 109 microversion: 2.1 time: 0.030757 Nov 21 13:59:40.863797 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 518/1040] 10.222.0.11 () {58 vars in 1244 bytes} [Sun Nov 21 13:59:40 2021] GET /compute/v2.1/os-volumes/dc3377f2-dde6-4d6e-a806-ffe2cfd35e80 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 13:59:58.049862 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-992d8465-88f3-47a9-b156-97f69c4d5e63 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:58.050426 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-992d8465-88f3-47a9-b156-97f69c4d5e63 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 7fdb301a-82fc-4b66-93ed-988cb00b0a58] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:58.056083 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-992d8465-88f3-47a9-b156-97f69c4d5e63 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:58.056535 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-992d8465-88f3-47a9-b156-97f69c4d5e63 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:58.057309 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-992d8465-88f3-47a9-b156-97f69c4d5e63 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:58.057751 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-992d8465-88f3-47a9-b156-97f69c4d5e63 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:58.137979 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.objects.instance [None req-992d8465-88f3-47a9-b156-97f69c4d5e63 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lazy-loading 'services' on Instance uuid 7fdb301a-82fc-4b66-93ed-988cb00b0a58 {{(pid=122564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 13:59:58.208889 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-992d8465-88f3-47a9-b156-97f69c4d5e63 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "DELETE /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58/os-volume_attachments/720adda3-e640-402d-9fc3-b29556f692c3" status: 202 len: 0 microversion: 2.1 time: 0.163602 Nov 21 13:59:58.209889 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 523/1041] 10.222.0.11 () {58 vars in 1415 bytes} [Sun Nov 21 13:59:58 2021] DELETE /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58/os-volume_attachments/720adda3-e640-402d-9fc3-b29556f692c3 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 21 13:59:59.318922 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-858f126d-899e-4119-809d-ac2f115b620a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:59.319425 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-858f126d-899e-4119-809d-ac2f115b620a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 7fdb301a-82fc-4b66-93ed-988cb00b0a58] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:59.325607 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-858f126d-899e-4119-809d-ac2f115b620a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:59.326126 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-858f126d-899e-4119-809d-ac2f115b620a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:59.326917 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-858f126d-899e-4119-809d-ac2f115b620a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:59.327348 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-858f126d-899e-4119-809d-ac2f115b620a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:59.350808 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-858f126d-899e-4119-809d-ac2f115b620a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 7fdb301a-82fc-4b66-93ed-988cb00b0a58] Going to try to terminate instance {{(pid=122565) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 21 13:59:59.426467 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-858f126d-899e-4119-809d-ac2f115b620a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "DELETE /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58" status: 204 len: 0 microversion: 2.1 time: 0.112499 Nov 21 13:59:59.427026 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 519/1042] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 13:59:59 2021] DELETE /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 13:59:59.435843 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-fa718827-5014-421f-b6fe-62138817fc7f tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 13:59:59.436540 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-fa718827-5014-421f-b6fe-62138817fc7f tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 7fdb301a-82fc-4b66-93ed-988cb00b0a58] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 13:59:59.443316 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fa718827-5014-421f-b6fe-62138817fc7f tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:59.443773 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fa718827-5014-421f-b6fe-62138817fc7f tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:59.444590 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fa718827-5014-421f-b6fe-62138817fc7f tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:59:59.445053 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-fa718827-5014-421f-b6fe-62138817fc7f tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:59:59.577039 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-fa718827-5014-421f-b6fe-62138817fc7f tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 13:59:59.585137 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-fa718827-5014-421f-b6fe-62138817fc7f tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58" status: 200 len: 1514 microversion: 2.1 time: 0.153746 Nov 21 13:59:59.585690 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 524/1043] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 13:59:59 2021] GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:00:00.602716 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-28051caf-6b4c-45af-9512-7ddb7711a995 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:00:00.603569 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-28051caf-6b4c-45af-9512-7ddb7711a995 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 7fdb301a-82fc-4b66-93ed-988cb00b0a58] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:00:00.610244 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-28051caf-6b4c-45af-9512-7ddb7711a995 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:00.610670 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-28051caf-6b4c-45af-9512-7ddb7711a995 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:00.612642 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-28051caf-6b4c-45af-9512-7ddb7711a995 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:00.613451 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-28051caf-6b4c-45af-9512-7ddb7711a995 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:00.753940 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-28051caf-6b4c-45af-9512-7ddb7711a995 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:00:00.761459 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-28051caf-6b4c-45af-9512-7ddb7711a995 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58" status: 200 len: 1514 microversion: 2.1 time: 0.162863 Nov 21 14:00:00.762046 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 520/1044] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:00:00 2021] GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:00:01.576958 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-e2e9fbda-1894-4e1b-bdff-00707d9e3f49 req-f17e3d67-79eb-4b7a-a107-2a83e44d6120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fdb301a-82fc-4b66-93ed-988cb00b0a58", "name": "network-vif-deleted", "tag": "8025d2bd-f151-4446-9381-c3834109dabf"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:00:01.578624 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 14:00:01.578624 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 14:00:01.586405 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-e2e9fbda-1894-4e1b-bdff-00707d9e3f49 req-f17e3d67-79eb-4b7a-a107-2a83e44d6120 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:01.586924 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-e2e9fbda-1894-4e1b-bdff-00707d9e3f49 req-f17e3d67-79eb-4b7a-a107-2a83e44d6120 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:01.598360 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-e2e9fbda-1894-4e1b-bdff-00707d9e3f49 req-f17e3d67-79eb-4b7a-a107-2a83e44d6120 service nova] Creating event network-vif-deleted:8025d2bd-f151-4446-9381-c3834109dabf for instance 7fdb301a-82fc-4b66-93ed-988cb00b0a58 on hv-cinder-76845 Nov 21 14:00:01.602989 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-e2e9fbda-1894-4e1b-bdff-00707d9e3f49 req-f17e3d67-79eb-4b7a-a107-2a83e44d6120 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030623 Nov 21 14:00:01.603570 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 525/1045] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 14:00:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:00:01.778368 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-b0912e2a-3e82-434a-a2d4-744c7b89348c tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:00:01.780340 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-b0912e2a-3e82-434a-a2d4-744c7b89348c tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 7fdb301a-82fc-4b66-93ed-988cb00b0a58] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:00:01.793211 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b0912e2a-3e82-434a-a2d4-744c7b89348c tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:01.793731 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b0912e2a-3e82-434a-a2d4-744c7b89348c tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:01.794709 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b0912e2a-3e82-434a-a2d4-744c7b89348c tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:01.795238 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b0912e2a-3e82-434a-a2d4-744c7b89348c tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:01.834430 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b0912e2a-3e82-434a-a2d4-744c7b89348c tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:01.834947 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-b0912e2a-3e82-434a-a2d4-744c7b89348c tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:01.835843 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.objects.instance [None req-b0912e2a-3e82-434a-a2d4-744c7b89348c tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lazy-loading 'fault' on Instance uuid 7fdb301a-82fc-4b66-93ed-988cb00b0a58 {{(pid=122565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 14:00:01.879183 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-b0912e2a-3e82-434a-a2d4-744c7b89348c tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:00:01.888658 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-b0912e2a-3e82-434a-a2d4-744c7b89348c tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58" status: 200 len: 1309 microversion: 2.1 time: 0.113981 Nov 21 14:00:01.895857 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 521/1046] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:00:01 2021] GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58 => generated 1309 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:00:02.907331 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-149ca841-7ac8-4c11-a932-8a400724b0df tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:00:02.907981 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-149ca841-7ac8-4c11-a932-8a400724b0df tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 7fdb301a-82fc-4b66-93ed-988cb00b0a58] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:00:02.914124 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-149ca841-7ac8-4c11-a932-8a400724b0df tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:02.914575 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-149ca841-7ac8-4c11-a932-8a400724b0df tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:02.915353 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-149ca841-7ac8-4c11-a932-8a400724b0df tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:02.915789 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-149ca841-7ac8-4c11-a932-8a400724b0df tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:02.928800 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.wsgi [None req-149ca841-7ac8-4c11-a932-8a400724b0df tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] HTTP exception thrown: Instance 7fdb301a-82fc-4b66-93ed-988cb00b0a58 could not be found. Nov 21 14:00:02.929374 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-149ca841-7ac8-4c11-a932-8a400724b0df tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Returning 404 to user: Instance 7fdb301a-82fc-4b66-93ed-988cb00b0a58 could not be found. {{(pid=122564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:00:02.930187 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-149ca841-7ac8-4c11-a932-8a400724b0df tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58" status: 404 len: 111 microversion: 2.1 time: 0.027426 Nov 21 14:00:02.930702 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 526/1047] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:00:02 2021] GET /compute/v2.1/servers/7fdb301a-82fc-4b66-93ed-988cb00b0a58 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:00:11.711294 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-0a1c46ef-466f-4834-a9f5-233f78172479 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-643429434", "imageRef": "acdb574e-2ba9-4029-849b-377b4d5722ce", "flavorRef": "452", "networks": [{"uuid": "6f097009-41cb-4ff1-a076-87e9a8cd07fe"}]}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:00:11.763783 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.network.neutron [None req-0a1c46ef-466f-4834-a9f5-233f78172479 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] validate_networks() for [('6f097009-41cb-4ff1-a076-87e9a8cd07fe', None, None, None, None, None)] {{(pid=122565) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 21 14:00:12.098403 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-0a1c46ef-466f-4834-a9f5-233f78172479 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Flavor limits 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 14:00:12.098824 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-0a1c46ef-466f-4834-a9f5-233f78172479 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Image limits 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 14:00:12.099291 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-0a1c46ef-466f-4834-a9f5-233f78172479 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Flavor pref 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 14:00:12.099728 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-0a1c46ef-466f-4834-a9f5-233f78172479 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Image pref 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 14:00:12.100157 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-0a1c46ef-466f-4834-a9f5-233f78172479 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 14:00:12.108674 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0a1c46ef-466f-4834-a9f5-233f78172479 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:12.109119 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0a1c46ef-466f-4834-a9f5-233f78172479 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:12.109928 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0a1c46ef-466f-4834-a9f5-233f78172479 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:12.110360 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0a1c46ef-466f-4834-a9f5-233f78172479 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:12.127183 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-0a1c46ef-466f-4834-a9f5-233f78172479 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Getting quotas for project b0b942babf814a7ead64e37a8ded8dff. Resources: {'instances', 'ram', 'cores'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 14:00:12.130920 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-0a1c46ef-466f-4834-a9f5-233f78172479 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Getting quotas for user feec808a4da948a394aabba9117d7d24 and project b0b942babf814a7ead64e37a8ded8dff. Resources: {'instances', 'ram', 'cores'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 14:00:12.141225 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-0a1c46ef-466f-4834-a9f5-233f78172479 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Going to run 1 instances... {{(pid=122565) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 14:00:12.143459 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-0a1c46ef-466f-4834-a9f5-233f78172479 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 1220b80a-6a6b-4c9a-b255-e850222f2666] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='acdb574e-2ba9-4029-849b-377b4d5722ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 14:00:12.186243 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-0a1c46ef-466f-4834-a9f5-233f78172479 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.478504 Nov 21 14:00:12.186879 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 522/1048] 10.222.0.11 () {60 vars in 1146 bytes} [Sun Nov 21 14:00:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 14:00:12.197295 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ef1b68c8-8aa4-44d0-ae2c-d1ffbb4ce4da tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:00:12.197911 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ef1b68c8-8aa4-44d0-ae2c-d1ffbb4ce4da tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 1220b80a-6a6b-4c9a-b255-e850222f2666] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:00:12.252127 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-ef1b68c8-8aa4-44d0-ae2c-d1ffbb4ce4da tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:00:12.258982 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ef1b68c8-8aa4-44d0-ae2c-d1ffbb4ce4da tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666" status: 200 len: 1218 microversion: 2.1 time: 0.065415 Nov 21 14:00:12.259547 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 527/1049] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:00:12 2021] GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:00:13.276599 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-59446a0b-5921-4b45-b2e4-6579066dc4e8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:00:13.277230 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-59446a0b-5921-4b45-b2e4-6579066dc4e8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 1220b80a-6a6b-4c9a-b255-e850222f2666] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:00:13.283420 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-59446a0b-5921-4b45-b2e4-6579066dc4e8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:13.284186 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-59446a0b-5921-4b45-b2e4-6579066dc4e8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:13.285197 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-59446a0b-5921-4b45-b2e4-6579066dc4e8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:13.285809 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-59446a0b-5921-4b45-b2e4-6579066dc4e8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:13.466939 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-59446a0b-5921-4b45-b2e4-6579066dc4e8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:00:13.474419 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-59446a0b-5921-4b45-b2e4-6579066dc4e8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666" status: 200 len: 1276 microversion: 2.1 time: 0.202138 Nov 21 14:00:13.474992 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 523/1050] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:00:13 2021] GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666 => generated 1276 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:00:14.492997 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-6a480016-b4b3-4314-8669-b87c4673e774 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:00:14.493874 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-6a480016-b4b3-4314-8669-b87c4673e774 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 1220b80a-6a6b-4c9a-b255-e850222f2666] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:00:14.503841 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6a480016-b4b3-4314-8669-b87c4673e774 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:14.504310 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6a480016-b4b3-4314-8669-b87c4673e774 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:14.505109 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6a480016-b4b3-4314-8669-b87c4673e774 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:14.505773 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-6a480016-b4b3-4314-8669-b87c4673e774 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:14.654858 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-6a480016-b4b3-4314-8669-b87c4673e774 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:00:14.663496 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-6a480016-b4b3-4314-8669-b87c4673e774 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666" status: 200 len: 1318 microversion: 2.1 time: 0.175644 Nov 21 14:00:14.664099 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 528/1051] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:00:14 2021] GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 14:00:14.701129 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-81c0928c-d8d5-4384-9630-88d17c77a19f req-202dff66-a10a-448c-9a1d-6c4a25830a3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1220b80a-6a6b-4c9a-b255-e850222f2666", "tag": "b2b26804-5f77-4013-9fe7-1a3d2c194944"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:00:14.703415 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 14:00:14.703415 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 14:00:14.712041 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-81c0928c-d8d5-4384-9630-88d17c77a19f req-202dff66-a10a-448c-9a1d-6c4a25830a3d service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:14.712496 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-81c0928c-d8d5-4384-9630-88d17c77a19f req-202dff66-a10a-448c-9a1d-6c4a25830a3d service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:14.723880 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-81c0928c-d8d5-4384-9630-88d17c77a19f req-202dff66-a10a-448c-9a1d-6c4a25830a3d service nova] Creating event network-changed:b2b26804-5f77-4013-9fe7-1a3d2c194944 for instance 1220b80a-6a6b-4c9a-b255-e850222f2666 on hv-cinder-76845 Nov 21 14:00:14.728647 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-81c0928c-d8d5-4384-9630-88d17c77a19f req-202dff66-a10a-448c-9a1d-6c4a25830a3d service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031130 Nov 21 14:00:14.729419 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 524/1052] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 14:00:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 14:00:15.680089 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-e9043222-7ca0-431f-b967-1bcec7c47a17 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:00:15.680705 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-e9043222-7ca0-431f-b967-1bcec7c47a17 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 1220b80a-6a6b-4c9a-b255-e850222f2666] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:00:15.687415 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e9043222-7ca0-431f-b967-1bcec7c47a17 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:15.687983 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e9043222-7ca0-431f-b967-1bcec7c47a17 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:15.688852 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e9043222-7ca0-431f-b967-1bcec7c47a17 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:15.689606 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e9043222-7ca0-431f-b967-1bcec7c47a17 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:15.819774 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-e9043222-7ca0-431f-b967-1bcec7c47a17 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:00:15.826964 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-e9043222-7ca0-431f-b967-1bcec7c47a17 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666" status: 200 len: 1318 microversion: 2.1 time: 0.150526 Nov 21 14:00:15.827522 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 529/1053] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:00:15 2021] GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:00:16.845644 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-73ef8daf-dae4-46d4-ad14-973fc193f9d3 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:00:16.846690 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-73ef8daf-dae4-46d4-ad14-973fc193f9d3 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 1220b80a-6a6b-4c9a-b255-e850222f2666] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:00:16.852753 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-73ef8daf-dae4-46d4-ad14-973fc193f9d3 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:16.853209 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-73ef8daf-dae4-46d4-ad14-973fc193f9d3 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:16.853994 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-73ef8daf-dae4-46d4-ad14-973fc193f9d3 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:16.854433 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-73ef8daf-dae4-46d4-ad14-973fc193f9d3 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:16.986257 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-73ef8daf-dae4-46d4-ad14-973fc193f9d3 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:00:16.993458 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-73ef8daf-dae4-46d4-ad14-973fc193f9d3 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666" status: 200 len: 1318 microversion: 2.1 time: 0.152802 Nov 21 14:00:16.994029 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 525/1054] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:00:16 2021] GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:00:18.010456 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-e09e55f3-1e43-4e6f-9180-e0a35ff188f8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:00:18.011292 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-e09e55f3-1e43-4e6f-9180-e0a35ff188f8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 1220b80a-6a6b-4c9a-b255-e850222f2666] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:00:18.017756 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e09e55f3-1e43-4e6f-9180-e0a35ff188f8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:18.018215 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e09e55f3-1e43-4e6f-9180-e0a35ff188f8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:18.019029 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e09e55f3-1e43-4e6f-9180-e0a35ff188f8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:18.019486 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e09e55f3-1e43-4e6f-9180-e0a35ff188f8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:18.159678 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-e09e55f3-1e43-4e6f-9180-e0a35ff188f8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:00:18.167516 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-e09e55f3-1e43-4e6f-9180-e0a35ff188f8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666" status: 200 len: 1318 microversion: 2.1 time: 0.160818 Nov 21 14:00:18.168681 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 530/1055] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:00:18 2021] GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:00:19.185135 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-752754d3-b942-4ce6-ac83-4ad2ecd99e42 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:00:19.185923 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-752754d3-b942-4ce6-ac83-4ad2ecd99e42 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 1220b80a-6a6b-4c9a-b255-e850222f2666] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:00:19.192749 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-752754d3-b942-4ce6-ac83-4ad2ecd99e42 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:19.193212 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-752754d3-b942-4ce6-ac83-4ad2ecd99e42 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:19.194108 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-752754d3-b942-4ce6-ac83-4ad2ecd99e42 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:19.194609 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-752754d3-b942-4ce6-ac83-4ad2ecd99e42 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:19.327650 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-752754d3-b942-4ce6-ac83-4ad2ecd99e42 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:00:19.335061 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-752754d3-b942-4ce6-ac83-4ad2ecd99e42 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666" status: 200 len: 1318 microversion: 2.1 time: 0.153588 Nov 21 14:00:19.335625 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 526/1056] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:00:19 2021] GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:00:20.255713 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-f844c85c-769b-48cd-8032-1656cf3c565c req-ff53c12c-4a45-4b53-b764-1308ca6851a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1220b80a-6a6b-4c9a-b255-e850222f2666", "name": "network-vif-plugged", "status": "completed", "tag": "b2b26804-5f77-4013-9fe7-1a3d2c194944"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:00:20.257618 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 14:00:20.257618 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 14:00:20.269148 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-f844c85c-769b-48cd-8032-1656cf3c565c req-ff53c12c-4a45-4b53-b764-1308ca6851a4 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:20.269897 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-f844c85c-769b-48cd-8032-1656cf3c565c req-ff53c12c-4a45-4b53-b764-1308ca6851a4 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:20.281806 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-f844c85c-769b-48cd-8032-1656cf3c565c req-ff53c12c-4a45-4b53-b764-1308ca6851a4 service nova] Creating event network-vif-plugged:b2b26804-5f77-4013-9fe7-1a3d2c194944 for instance 1220b80a-6a6b-4c9a-b255-e850222f2666 on hv-cinder-76845 Nov 21 14:00:20.288435 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-f844c85c-769b-48cd-8032-1656cf3c565c req-ff53c12c-4a45-4b53-b764-1308ca6851a4 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037029 Nov 21 14:00:20.289681 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 531/1057] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 14:00:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 14:00:20.352283 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ef2b3100-8fe9-4e76-b2f0-2bd8950654cb tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:00:20.352890 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ef2b3100-8fe9-4e76-b2f0-2bd8950654cb tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 1220b80a-6a6b-4c9a-b255-e850222f2666] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:00:20.360119 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ef2b3100-8fe9-4e76-b2f0-2bd8950654cb tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:20.360717 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ef2b3100-8fe9-4e76-b2f0-2bd8950654cb tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:20.361637 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ef2b3100-8fe9-4e76-b2f0-2bd8950654cb tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:20.362160 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ef2b3100-8fe9-4e76-b2f0-2bd8950654cb tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:20.527435 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ef2b3100-8fe9-4e76-b2f0-2bd8950654cb tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:00:20.534898 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ef2b3100-8fe9-4e76-b2f0-2bd8950654cb tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666" status: 200 len: 1318 microversion: 2.1 time: 0.186892 Nov 21 14:00:20.535461 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 527/1058] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:00:20 2021] GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:00:21.553597 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-1bc2fb05-8b51-427d-b7c8-44bb33dd48fd tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:00:21.554204 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-1bc2fb05-8b51-427d-b7c8-44bb33dd48fd tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 1220b80a-6a6b-4c9a-b255-e850222f2666] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:00:21.560738 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1bc2fb05-8b51-427d-b7c8-44bb33dd48fd tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:21.561183 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1bc2fb05-8b51-427d-b7c8-44bb33dd48fd tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:21.561963 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1bc2fb05-8b51-427d-b7c8-44bb33dd48fd tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:21.562394 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-1bc2fb05-8b51-427d-b7c8-44bb33dd48fd tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:21.696375 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-1bc2fb05-8b51-427d-b7c8-44bb33dd48fd tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:00:21.707472 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-1bc2fb05-8b51-427d-b7c8-44bb33dd48fd tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666" status: 200 len: 1318 microversion: 2.1 time: 0.157998 Nov 21 14:00:21.708234 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 532/1059] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:00:21 2021] GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:00:22.725823 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-0be8af81-b046-4933-ac0f-942aba74b58b tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:00:22.726435 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-0be8af81-b046-4933-ac0f-942aba74b58b tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 1220b80a-6a6b-4c9a-b255-e850222f2666] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:00:22.732770 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0be8af81-b046-4933-ac0f-942aba74b58b tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:22.733228 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0be8af81-b046-4933-ac0f-942aba74b58b tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:22.734010 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0be8af81-b046-4933-ac0f-942aba74b58b tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:22.734451 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0be8af81-b046-4933-ac0f-942aba74b58b tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:22.864043 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-0be8af81-b046-4933-ac0f-942aba74b58b tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:00:22.871325 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-0be8af81-b046-4933-ac0f-942aba74b58b tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666" status: 200 len: 1507 microversion: 2.1 time: 0.149231 Nov 21 14:00:22.871913 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 528/1060] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:00:22 2021] GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:00:22.888788 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2a8509df-6442-45a0-8e26-4de69778ac11 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d145d86d-52ef-4d13-bda9-cecebc63aefd", "device": "/dev/sdb"}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:00:22.890256 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-2a8509df-6442-45a0-8e26-4de69778ac11 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 1220b80a-6a6b-4c9a-b255-e850222f2666] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:00:22.896510 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2a8509df-6442-45a0-8e26-4de69778ac11 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:22.896966 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2a8509df-6442-45a0-8e26-4de69778ac11 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:22.897749 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2a8509df-6442-45a0-8e26-4de69778ac11 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:22.898189 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2a8509df-6442-45a0-8e26-4de69778ac11 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:23.130607 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-2a8509df-6442-45a0-8e26-4de69778ac11 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "POST /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245477 Nov 21 14:00:23.131436 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 533/1061] 10.222.0.11 () {60 vars in 1322 bytes} [Sun Nov 21 14:00:22 2021] POST /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:00:41.309812 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-873819e8-bbff-4e6f-a96d-47d541ca9788 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:00:41.310308 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-873819e8-bbff-4e6f-a96d-47d541ca9788 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 1220b80a-6a6b-4c9a-b255-e850222f2666] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:00:41.316343 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-873819e8-bbff-4e6f-a96d-47d541ca9788 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:41.317029 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-873819e8-bbff-4e6f-a96d-47d541ca9788 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:41.317901 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-873819e8-bbff-4e6f-a96d-47d541ca9788 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:41.318543 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-873819e8-bbff-4e6f-a96d-47d541ca9788 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:41.397521 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.objects.instance [None req-873819e8-bbff-4e6f-a96d-47d541ca9788 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lazy-loading 'services' on Instance uuid 1220b80a-6a6b-4c9a-b255-e850222f2666 {{(pid=122565) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 14:00:41.473299 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-873819e8-bbff-4e6f-a96d-47d541ca9788 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "DELETE /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666/os-volume_attachments/d145d86d-52ef-4d13-bda9-cecebc63aefd" status: 202 len: 0 microversion: 2.1 time: 0.165772 Nov 21 14:00:41.473896 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 529/1062] 10.222.0.11 () {58 vars in 1415 bytes} [Sun Nov 21 14:00:41 2021] DELETE /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666/os-volume_attachments/d145d86d-52ef-4d13-bda9-cecebc63aefd => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:00:42.592695 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-31b4865e-4e3b-4479-b0fb-056a590eb0b8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:00:42.593275 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-31b4865e-4e3b-4479-b0fb-056a590eb0b8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 1220b80a-6a6b-4c9a-b255-e850222f2666] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:00:42.600401 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-31b4865e-4e3b-4479-b0fb-056a590eb0b8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:42.600970 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-31b4865e-4e3b-4479-b0fb-056a590eb0b8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:42.601987 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-31b4865e-4e3b-4479-b0fb-056a590eb0b8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:42.602721 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-31b4865e-4e3b-4479-b0fb-056a590eb0b8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:42.627080 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-31b4865e-4e3b-4479-b0fb-056a590eb0b8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 1220b80a-6a6b-4c9a-b255-e850222f2666] Going to try to terminate instance {{(pid=122564) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 21 14:00:42.705978 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-31b4865e-4e3b-4479-b0fb-056a590eb0b8 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "DELETE /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666" status: 204 len: 0 microversion: 2.1 time: 0.117227 Nov 21 14:00:42.706668 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 534/1063] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 14:00:42 2021] DELETE /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:00:42.717432 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c818902e-ab50-40bf-95b7-21dc49d1c908 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:00:42.718139 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-c818902e-ab50-40bf-95b7-21dc49d1c908 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 1220b80a-6a6b-4c9a-b255-e850222f2666] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:00:42.725687 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c818902e-ab50-40bf-95b7-21dc49d1c908 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:42.726242 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c818902e-ab50-40bf-95b7-21dc49d1c908 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:42.726904 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c818902e-ab50-40bf-95b7-21dc49d1c908 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:42.727343 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c818902e-ab50-40bf-95b7-21dc49d1c908 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:42.862777 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-c818902e-ab50-40bf-95b7-21dc49d1c908 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:00:42.871282 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c818902e-ab50-40bf-95b7-21dc49d1c908 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666" status: 200 len: 1513 microversion: 2.1 time: 0.159029 Nov 21 14:00:42.881791 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 530/1064] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:00:42 2021] GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:00:43.889358 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-20caf3c1-116b-4d5c-af65-605233e01573 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:00:43.890085 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-20caf3c1-116b-4d5c-af65-605233e01573 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 1220b80a-6a6b-4c9a-b255-e850222f2666] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:00:43.896958 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-20caf3c1-116b-4d5c-af65-605233e01573 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:43.897411 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-20caf3c1-116b-4d5c-af65-605233e01573 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:43.898190 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-20caf3c1-116b-4d5c-af65-605233e01573 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:43.898629 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-20caf3c1-116b-4d5c-af65-605233e01573 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:44.041169 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-20caf3c1-116b-4d5c-af65-605233e01573 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:00:44.049006 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-20caf3c1-116b-4d5c-af65-605233e01573 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666" status: 200 len: 1513 microversion: 2.1 time: 0.163677 Nov 21 14:00:44.049490 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 535/1065] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:00:43 2021] GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 14:00:44.868579 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-df9479c8-2b19-426b-938f-b05a3041c23d req-34134112-a254-4bfa-b81d-449ea619a5de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1220b80a-6a6b-4c9a-b255-e850222f2666", "name": "network-vif-deleted", "tag": "b2b26804-5f77-4013-9fe7-1a3d2c194944"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:00:44.870073 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 14:00:44.870073 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 14:00:44.880173 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-df9479c8-2b19-426b-938f-b05a3041c23d req-34134112-a254-4bfa-b81d-449ea619a5de service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:44.880674 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-df9479c8-2b19-426b-938f-b05a3041c23d req-34134112-a254-4bfa-b81d-449ea619a5de service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:44.893871 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-df9479c8-2b19-426b-938f-b05a3041c23d req-34134112-a254-4bfa-b81d-449ea619a5de service nova] Creating event network-vif-deleted:b2b26804-5f77-4013-9fe7-1a3d2c194944 for instance 1220b80a-6a6b-4c9a-b255-e850222f2666 on hv-cinder-76845 Nov 21 14:00:44.900663 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-df9479c8-2b19-426b-938f-b05a3041c23d req-34134112-a254-4bfa-b81d-449ea619a5de service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035676 Nov 21 14:00:44.901254 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 531/1066] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 14:00:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:00:45.064874 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-17d46ca6-dc62-4c66-9cb2-3aeff9123cfc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:00:45.065426 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-17d46ca6-dc62-4c66-9cb2-3aeff9123cfc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 1220b80a-6a6b-4c9a-b255-e850222f2666] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:00:45.072482 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-17d46ca6-dc62-4c66-9cb2-3aeff9123cfc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:45.072733 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-17d46ca6-dc62-4c66-9cb2-3aeff9123cfc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:45.073540 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-17d46ca6-dc62-4c66-9cb2-3aeff9123cfc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:45.073980 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-17d46ca6-dc62-4c66-9cb2-3aeff9123cfc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:45.104758 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-17d46ca6-dc62-4c66-9cb2-3aeff9123cfc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:45.105576 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-17d46ca6-dc62-4c66-9cb2-3aeff9123cfc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:45.106036 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.objects.instance [None req-17d46ca6-dc62-4c66-9cb2-3aeff9123cfc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lazy-loading 'fault' on Instance uuid 1220b80a-6a6b-4c9a-b255-e850222f2666 {{(pid=122564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 14:00:45.150226 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-17d46ca6-dc62-4c66-9cb2-3aeff9123cfc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feec808a4da948a394aabba9117d7d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b942babf814a7ead64e37a8ded8dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:00:45.157408 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-17d46ca6-dc62-4c66-9cb2-3aeff9123cfc tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666" status: 200 len: 1308 microversion: 2.1 time: 0.096318 Nov 21 14:00:45.157965 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 536/1067] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:00:45 2021] GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:00:46.176617 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-6a175529-337e-4996-9b96-22794c59d252 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:00:46.177894 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-6a175529-337e-4996-9b96-22794c59d252 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] [instance: 1220b80a-6a6b-4c9a-b255-e850222f2666] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:00:46.184341 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6a175529-337e-4996-9b96-22794c59d252 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:46.184789 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6a175529-337e-4996-9b96-22794c59d252 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:46.185556 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6a175529-337e-4996-9b96-22794c59d252 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:00:46.185988 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-6a175529-337e-4996-9b96-22794c59d252 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:00:46.199036 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-6a175529-337e-4996-9b96-22794c59d252 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] HTTP exception thrown: Instance 1220b80a-6a6b-4c9a-b255-e850222f2666 could not be found. Nov 21 14:00:46.199612 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-6a175529-337e-4996-9b96-22794c59d252 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Returning 404 to user: Instance 1220b80a-6a6b-4c9a-b255-e850222f2666 could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:00:46.200433 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-6a175529-337e-4996-9b96-22794c59d252 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666" status: 404 len: 111 microversion: 2.1 time: 0.027870 Nov 21 14:00:46.200937 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 532/1068] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:00:46 2021] GET /compute/v2.1/servers/1220b80a-6a6b-4c9a-b255-e850222f2666 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:01:24.762557 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-300d5f64-d900-4f9f-a13b-deef82e2faf6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Action: 'create', calling method: .version_select at 0x7fd513b739d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1360452644"}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:01:24.777184 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-300d5f64-d900-4f9f-a13b-deef82e2faf6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Getting quotas for project db51095fd43e4fe5855207bd0ea7a651. Resources: {'key_pairs'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 14:01:24.781251 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-300d5f64-d900-4f9f-a13b-deef82e2faf6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Getting quotas for user c85790f3393844f68ea138c3b6af8043 and project db51095fd43e4fe5855207bd0ea7a651. Resources: {'key_pairs'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 14:01:24.955612 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-300d5f64-d900-4f9f-a13b-deef82e2faf6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Getting quotas for project db51095fd43e4fe5855207bd0ea7a651. Resources: {'key_pairs'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 14:01:24.961048 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-300d5f64-d900-4f9f-a13b-deef82e2faf6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Getting quotas for user c85790f3393844f68ea138c3b6af8043 and project db51095fd43e4fe5855207bd0ea7a651. Resources: {'key_pairs'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 14:01:24.974354 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-300d5f64-d900-4f9f-a13b-deef82e2faf6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.377054 Nov 21 14:01:24.975064 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 537/1069] 10.222.0.11 () {60 vars in 1157 bytes} [Sun Nov 21 14:01:24 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:01:43.189153 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-9c1977e8-204b-42fb-b981-5e8d47d78564 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-36633379", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1360452644", "security_groups": [{"name": "tempest-secgroup-smoke-847620947"}], "block_device_mapping_v2": [{"uuid": "cb9464ee-00ea-4a67-a4a3-75045151ebcc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8"}]}} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:01:43.390981 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.network.neutron [None req-9c1977e8-204b-42fb-b981-5e8d47d78564 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] validate_networks() for [('4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', None, None, None, None, None)] {{(pid=122565) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 21 14:01:43.742319 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-9c1977e8-204b-42fb-b981-5e8d47d78564 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Flavor limits 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 14:01:43.742753 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-9c1977e8-204b-42fb-b981-5e8d47d78564 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Image limits 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 14:01:43.743237 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-9c1977e8-204b-42fb-b981-5e8d47d78564 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Flavor pref 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 14:01:43.743654 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-9c1977e8-204b-42fb-b981-5e8d47d78564 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Image pref 0:0:0 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 14:01:43.744142 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.virt.hardware [None req-9c1977e8-204b-42fb-b981-5e8d47d78564 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122565) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 14:01:43.753033 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9c1977e8-204b-42fb-b981-5e8d47d78564 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:43.753486 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9c1977e8-204b-42fb-b981-5e8d47d78564 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:43.754315 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9c1977e8-204b-42fb-b981-5e8d47d78564 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:43.754780 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-9c1977e8-204b-42fb-b981-5e8d47d78564 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:43.772431 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-9c1977e8-204b-42fb-b981-5e8d47d78564 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Getting quotas for project db51095fd43e4fe5855207bd0ea7a651. Resources: {'instances', 'ram', 'cores'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 14:01:43.777374 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.quota [None req-9c1977e8-204b-42fb-b981-5e8d47d78564 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Getting quotas for user c85790f3393844f68ea138c3b6af8043 and project db51095fd43e4fe5855207bd0ea7a651. Resources: {'instances', 'ram', 'cores'} {{(pid=122565) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 14:01:43.830806 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-9c1977e8-204b-42fb-b981-5e8d47d78564 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Going to run 1 instances... {{(pid=122565) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 14:01:43.832967 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-9c1977e8-204b-42fb-b981-5e8d47d78564 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cb9464ee-00ea-4a67-a4a3-75045151ebcc',volume_size=None,volume_type=None)] {{(pid=122565) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 14:01:43.952305 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-9c1977e8-204b-42fb-b981-5e8d47d78564 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.766848 Nov 21 14:01:43.952876 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 533/1070] 10.222.0.11 () {60 vars in 1146 bytes} [Sun Nov 21 14:01:43 2021] POST /compute/v2.1/servers => generated 405 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 14:01:43.963078 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-5c00f0b6-148f-4a7d-bef8-384f6c1ad057 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:01:43.963690 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-5c00f0b6-148f-4a7d-bef8-384f6c1ad057 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:01:44.111236 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-5c00f0b6-148f-4a7d-bef8-384f6c1ad057 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:01:44.118782 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-5c00f0b6-148f-4a7d-bef8-384f6c1ad057 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 200 len: 1093 microversion: 2.1 time: 0.159862 Nov 21 14:01:44.119883 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 538/1071] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:01:43 2021] GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 1093 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:01:44.811181 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 14:01:44.811433 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: Sun Nov 21 14:01:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 14:01:45.137063 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-e20c9364-a9c7-45f7-9655-364d385bd6dd tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:01:45.137677 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-e20c9364-a9c7-45f7-9655-364d385bd6dd tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:01:45.144222 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e20c9364-a9c7-45f7-9655-364d385bd6dd tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:45.144682 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e20c9364-a9c7-45f7-9655-364d385bd6dd tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:45.145472 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e20c9364-a9c7-45f7-9655-364d385bd6dd tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:45.145915 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e20c9364-a9c7-45f7-9655-364d385bd6dd tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:45.213817 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-e20c9364-a9c7-45f7-9655-364d385bd6dd tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:01:45.221410 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-e20c9364-a9c7-45f7-9655-364d385bd6dd tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 200 len: 1209 microversion: 2.1 time: 0.088558 Nov 21 14:01:45.222165 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 534/1072] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:01:45 2021] GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:01:46.238384 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-8ec913e8-a912-466a-9960-1b1e691218b1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:01:46.239552 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-8ec913e8-a912-466a-9960-1b1e691218b1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:01:46.246332 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8ec913e8-a912-466a-9960-1b1e691218b1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:46.247048 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8ec913e8-a912-466a-9960-1b1e691218b1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:46.247854 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8ec913e8-a912-466a-9960-1b1e691218b1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:46.248296 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8ec913e8-a912-466a-9960-1b1e691218b1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:46.279713 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-2f10c0e3-806a-4aef-a9b7-df69a31adab5 req-627abb9c-f2a6-4297-9f22-e00f4954d7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9014772b-e240-4c5f-8abc-76aa454938ab", "tag": "489a10b7-9731-4d59-9d05-a3c042350821"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:01:46.281298 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 14:01:46.281298 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 14:01:46.302969 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-2f10c0e3-806a-4aef-a9b7-df69a31adab5 req-627abb9c-f2a6-4297-9f22-e00f4954d7e2 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:46.303417 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-2f10c0e3-806a-4aef-a9b7-df69a31adab5 req-627abb9c-f2a6-4297-9f22-e00f4954d7e2 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:46.316476 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-2f10c0e3-806a-4aef-a9b7-df69a31adab5 req-627abb9c-f2a6-4297-9f22-e00f4954d7e2 service nova] Creating event network-changed:489a10b7-9731-4d59-9d05-a3c042350821 for instance 9014772b-e240-4c5f-8abc-76aa454938ab on hv-cinder-76845 Nov 21 14:01:46.321431 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-2f10c0e3-806a-4aef-a9b7-df69a31adab5 req-627abb9c-f2a6-4297-9f22-e00f4954d7e2 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045759 Nov 21 14:01:46.322135 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 535/1073] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 14:01:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 14:01:46.409144 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-8ec913e8-a912-466a-9960-1b1e691218b1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:01:46.417753 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-8ec913e8-a912-466a-9960-1b1e691218b1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 200 len: 1264 microversion: 2.1 time: 0.182961 Nov 21 14:01:46.418422 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 539/1074] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:01:46 2021] GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:01:47.435242 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-cd04bcab-1aab-4724-bc24-ea01f050dff0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:01:47.435968 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-cd04bcab-1aab-4724-bc24-ea01f050dff0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:01:47.442353 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cd04bcab-1aab-4724-bc24-ea01f050dff0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:47.442808 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cd04bcab-1aab-4724-bc24-ea01f050dff0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:47.443598 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cd04bcab-1aab-4724-bc24-ea01f050dff0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:47.444069 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-cd04bcab-1aab-4724-bc24-ea01f050dff0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:47.580430 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-cd04bcab-1aab-4724-bc24-ea01f050dff0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:01:47.587640 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-cd04bcab-1aab-4724-bc24-ea01f050dff0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 200 len: 1264 microversion: 2.1 time: 0.156819 Nov 21 14:01:47.588287 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 536/1075] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:01:47 2021] GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:01:48.604501 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-f2acf18e-ae09-4a5d-b223-b55335606d75 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:01:48.605038 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-f2acf18e-ae09-4a5d-b223-b55335606d75 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:01:48.611368 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f2acf18e-ae09-4a5d-b223-b55335606d75 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:48.611828 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f2acf18e-ae09-4a5d-b223-b55335606d75 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:48.612617 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f2acf18e-ae09-4a5d-b223-b55335606d75 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:48.613051 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f2acf18e-ae09-4a5d-b223-b55335606d75 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:48.742902 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-f2acf18e-ae09-4a5d-b223-b55335606d75 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:01:48.750947 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-f2acf18e-ae09-4a5d-b223-b55335606d75 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 200 len: 1264 microversion: 2.1 time: 0.150268 Nov 21 14:01:48.751514 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 540/1076] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:01:48 2021] GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:01:49.767669 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-2cc4efe8-4cdc-4a02-9991-c9d779d75d82 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:01:49.768241 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-2cc4efe8-4cdc-4a02-9991-c9d779d75d82 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:01:49.774478 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2cc4efe8-4cdc-4a02-9991-c9d779d75d82 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:49.774933 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2cc4efe8-4cdc-4a02-9991-c9d779d75d82 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:49.775706 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2cc4efe8-4cdc-4a02-9991-c9d779d75d82 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:49.776172 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2cc4efe8-4cdc-4a02-9991-c9d779d75d82 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:49.906196 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2cc4efe8-4cdc-4a02-9991-c9d779d75d82 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:01:49.913490 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-2cc4efe8-4cdc-4a02-9991-c9d779d75d82 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 200 len: 1264 microversion: 2.1 time: 0.149628 Nov 21 14:01:49.914054 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 537/1077] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:01:49 2021] GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 14:01:50.404414 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 14:01:50.404607 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: Sun Nov 21 14:01:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 14:01:50.930720 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-c051352b-af71-42a4-8fc8-ed60161cebf3 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:01:50.931317 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-c051352b-af71-42a4-8fc8-ed60161cebf3 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:01:50.937548 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c051352b-af71-42a4-8fc8-ed60161cebf3 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:50.937997 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c051352b-af71-42a4-8fc8-ed60161cebf3 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:50.938780 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c051352b-af71-42a4-8fc8-ed60161cebf3 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:50.939216 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c051352b-af71-42a4-8fc8-ed60161cebf3 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:51.069577 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-c051352b-af71-42a4-8fc8-ed60161cebf3 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:01:51.077466 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-c051352b-af71-42a4-8fc8-ed60161cebf3 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 200 len: 1264 microversion: 2.1 time: 0.150489 Nov 21 14:01:51.078022 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 541/1078] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:01:50 2021] GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:01:52.094394 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-d95a2e5f-430c-4f1b-a5d7-cb203d0bf264 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:01:52.095051 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-d95a2e5f-430c-4f1b-a5d7-cb203d0bf264 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:01:52.101327 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d95a2e5f-430c-4f1b-a5d7-cb203d0bf264 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:52.101780 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d95a2e5f-430c-4f1b-a5d7-cb203d0bf264 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:52.102562 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d95a2e5f-430c-4f1b-a5d7-cb203d0bf264 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:52.103001 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-d95a2e5f-430c-4f1b-a5d7-cb203d0bf264 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:52.235320 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-d95a2e5f-430c-4f1b-a5d7-cb203d0bf264 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:01:52.242524 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-d95a2e5f-430c-4f1b-a5d7-cb203d0bf264 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 200 len: 1264 microversion: 2.1 time: 0.151829 Nov 21 14:01:52.243077 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 538/1079] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:01:52 2021] GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:01:53.259680 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-0a8d16dd-723a-4d96-b82d-8a75dafba4e4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:01:53.260311 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-0a8d16dd-723a-4d96-b82d-8a75dafba4e4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:01:53.266621 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0a8d16dd-723a-4d96-b82d-8a75dafba4e4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:53.267113 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0a8d16dd-723a-4d96-b82d-8a75dafba4e4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:53.267925 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0a8d16dd-723a-4d96-b82d-8a75dafba4e4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:53.268369 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-0a8d16dd-723a-4d96-b82d-8a75dafba4e4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:53.395106 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-0a8d16dd-723a-4d96-b82d-8a75dafba4e4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:01:53.402284 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-0a8d16dd-723a-4d96-b82d-8a75dafba4e4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 200 len: 1264 microversion: 2.1 time: 0.146297 Nov 21 14:01:53.402846 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 542/1080] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:01:53 2021] GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:01:54.419402 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-78d8e44a-7f1c-47f7-abc5-9281d5c8c624 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:01:54.420046 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-78d8e44a-7f1c-47f7-abc5-9281d5c8c624 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:01:54.426355 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-78d8e44a-7f1c-47f7-abc5-9281d5c8c624 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:54.426798 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-78d8e44a-7f1c-47f7-abc5-9281d5c8c624 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:54.427572 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-78d8e44a-7f1c-47f7-abc5-9281d5c8c624 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:54.428041 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-78d8e44a-7f1c-47f7-abc5-9281d5c8c624 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:54.554433 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-78d8e44a-7f1c-47f7-abc5-9281d5c8c624 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:01:54.561592 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-78d8e44a-7f1c-47f7-abc5-9281d5c8c624 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 200 len: 1264 microversion: 2.1 time: 0.146354 Nov 21 14:01:54.562169 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 539/1081] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:01:54 2021] GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:01:55.578247 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-113b5676-2c73-486d-b53b-abc38a9ccc46 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:01:55.578854 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-113b5676-2c73-486d-b53b-abc38a9ccc46 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:01:55.585090 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-113b5676-2c73-486d-b53b-abc38a9ccc46 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:55.585581 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-113b5676-2c73-486d-b53b-abc38a9ccc46 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:55.586317 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-113b5676-2c73-486d-b53b-abc38a9ccc46 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:55.586751 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-113b5676-2c73-486d-b53b-abc38a9ccc46 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:55.714995 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-113b5676-2c73-486d-b53b-abc38a9ccc46 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:01:55.722243 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-113b5676-2c73-486d-b53b-abc38a9ccc46 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 200 len: 1264 microversion: 2.1 time: 0.147712 Nov 21 14:01:55.722801 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 543/1082] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:01:55 2021] GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:01:56.738464 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-7444e3f7-768d-435d-8f36-5bb892685133 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:01:56.739077 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-7444e3f7-768d-435d-8f36-5bb892685133 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:01:56.745802 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7444e3f7-768d-435d-8f36-5bb892685133 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:56.746253 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7444e3f7-768d-435d-8f36-5bb892685133 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:56.747281 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7444e3f7-768d-435d-8f36-5bb892685133 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:56.747717 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7444e3f7-768d-435d-8f36-5bb892685133 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:56.883372 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-7444e3f7-768d-435d-8f36-5bb892685133 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:01:56.892361 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-7444e3f7-768d-435d-8f36-5bb892685133 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 200 len: 1264 microversion: 2.1 time: 0.157490 Nov 21 14:01:56.893097 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 540/1083] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:01:56 2021] GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:01:56.904185 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-f911da59-8676-4964-9513-248a9589566d req-bf5435e1-2147-4e2b-9625-74aa273e8b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9014772b-e240-4c5f-8abc-76aa454938ab", "name": "network-vif-plugged", "status": "completed", "tag": "489a10b7-9731-4d59-9d05-a3c042350821"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:01:56.905726 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 14:01:56.905726 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 14:01:56.913345 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-f911da59-8676-4964-9513-248a9589566d req-bf5435e1-2147-4e2b-9625-74aa273e8b8b service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:56.913798 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-f911da59-8676-4964-9513-248a9589566d req-bf5435e1-2147-4e2b-9625-74aa273e8b8b service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:56.925021 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-f911da59-8676-4964-9513-248a9589566d req-bf5435e1-2147-4e2b-9625-74aa273e8b8b service nova] Creating event network-vif-plugged:489a10b7-9731-4d59-9d05-a3c042350821 for instance 9014772b-e240-4c5f-8abc-76aa454938ab on hv-cinder-76845 Nov 21 14:01:56.930064 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-f911da59-8676-4964-9513-248a9589566d req-bf5435e1-2147-4e2b-9625-74aa273e8b8b service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029689 Nov 21 14:01:56.930653 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 544/1084] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 14:01:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:01:57.909773 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-92acc6ce-6145-4aa4-b60a-f58b7c422843 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:01:57.910384 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-92acc6ce-6145-4aa4-b60a-f58b7c422843 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:01:57.917126 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-92acc6ce-6145-4aa4-b60a-f58b7c422843 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:57.917573 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-92acc6ce-6145-4aa4-b60a-f58b7c422843 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:57.918349 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-92acc6ce-6145-4aa4-b60a-f58b7c422843 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:57.918784 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-92acc6ce-6145-4aa4-b60a-f58b7c422843 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:58.053592 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-92acc6ce-6145-4aa4-b60a-f58b7c422843 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:01:58.061383 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-92acc6ce-6145-4aa4-b60a-f58b7c422843 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 200 len: 1264 microversion: 2.1 time: 0.155308 Nov 21 14:01:58.061943 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 541/1085] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:01:57 2021] GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:01:59.079717 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-dd7537fa-5ff7-4c13-9127-c13232d74aad tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:01:59.080453 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-dd7537fa-5ff7-4c13-9127-c13232d74aad tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:01:59.086527 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-dd7537fa-5ff7-4c13-9127-c13232d74aad tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:59.086983 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-dd7537fa-5ff7-4c13-9127-c13232d74aad tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:59.087770 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-dd7537fa-5ff7-4c13-9127-c13232d74aad tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:59.088238 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-dd7537fa-5ff7-4c13-9127-c13232d74aad tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:59.219998 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-dd7537fa-5ff7-4c13-9127-c13232d74aad tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:01:59.227246 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-dd7537fa-5ff7-4c13-9127-c13232d74aad tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 200 len: 1451 microversion: 2.1 time: 0.152028 Nov 21 14:01:59.227820 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 545/1086] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:01:59 2021] GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:01:59.244269 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-1569b56c-4c51-43af-a2c5-105f92c9fb40 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:01:59.244887 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-1569b56c-4c51-43af-a2c5-105f92c9fb40 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:01:59.251332 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1569b56c-4c51-43af-a2c5-105f92c9fb40 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:59.251783 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1569b56c-4c51-43af-a2c5-105f92c9fb40 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:59.252591 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1569b56c-4c51-43af-a2c5-105f92c9fb40 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:01:59.253028 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-1569b56c-4c51-43af-a2c5-105f92c9fb40 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:01:59.380184 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-1569b56c-4c51-43af-a2c5-105f92c9fb40 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:01:59.387431 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-1569b56c-4c51-43af-a2c5-105f92c9fb40 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 200 len: 1451 microversion: 2.1 time: 0.147435 Nov 21 14:01:59.388016 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 542/1087] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:01:59 2021] GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:02:01.263304 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-729ebdd4-0646-40be-87fc-2b4b244d9e9f req-10a8078e-774d-4f76-b76f-587c20160e27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9014772b-e240-4c5f-8abc-76aa454938ab", "tag": "489a10b7-9731-4d59-9d05-a3c042350821"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:02:01.264841 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 14:02:01.264841 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 14:02:01.271557 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-729ebdd4-0646-40be-87fc-2b4b244d9e9f req-10a8078e-774d-4f76-b76f-587c20160e27 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:02:01.272051 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-729ebdd4-0646-40be-87fc-2b4b244d9e9f req-10a8078e-774d-4f76-b76f-587c20160e27 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:02:01.282761 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-729ebdd4-0646-40be-87fc-2b4b244d9e9f req-10a8078e-774d-4f76-b76f-587c20160e27 service nova] Creating event network-changed:489a10b7-9731-4d59-9d05-a3c042350821 for instance 9014772b-e240-4c5f-8abc-76aa454938ab on hv-cinder-76845 Nov 21 14:02:01.289485 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-729ebdd4-0646-40be-87fc-2b4b244d9e9f req-10a8078e-774d-4f76-b76f-587c20160e27 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034688 Nov 21 14:02:01.290188 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 546/1088] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 14:02:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:03:58.536610 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a5f5b830-4d11-41a0-af20-b6dd6908f282 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:03:58.537127 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a5f5b830-4d11-41a0-af20-b6dd6908f282 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:03:58.542906 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a5f5b830-4d11-41a0-af20-b6dd6908f282 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:03:58.543359 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a5f5b830-4d11-41a0-af20-b6dd6908f282 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:03:58.544171 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a5f5b830-4d11-41a0-af20-b6dd6908f282 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:03:58.544606 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a5f5b830-4d11-41a0-af20-b6dd6908f282 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:03:58.568393 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a5f5b830-4d11-41a0-af20-b6dd6908f282 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Going to try to terminate instance {{(pid=122565) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 21 14:03:58.638805 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a5f5b830-4d11-41a0-af20-b6dd6908f282 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "DELETE /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 204 len: 0 microversion: 2.1 time: 0.105923 Nov 21 14:03:58.639408 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 543/1089] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 14:03:58 2021] DELETE /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:03:58.646768 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d819ebd3-4161-4c9c-9b8f-2b9a0b3cb916] AMQP server on 10.222.0.11:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 21 14:03:58.650994 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-7d2f41d8-67a8-4065-adab-e63f813bbe4c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:03:58.651721 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-7d2f41d8-67a8-4065-adab-e63f813bbe4c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:03:58.657746 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7d2f41d8-67a8-4065-adab-e63f813bbe4c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:03:58.658190 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7d2f41d8-67a8-4065-adab-e63f813bbe4c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:03:58.658957 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7d2f41d8-67a8-4065-adab-e63f813bbe4c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:03:58.659387 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-7d2f41d8-67a8-4065-adab-e63f813bbe4c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:03:58.799584 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-7d2f41d8-67a8-4065-adab-e63f813bbe4c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:03:58.806993 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-7d2f41d8-67a8-4065-adab-e63f813bbe4c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 200 len: 1576 microversion: 2.1 time: 0.163077 Nov 21 14:03:58.807552 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 547/1090] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:03:58 2021] GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 14:03:59.825718 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-099a0ed7-0395-4696-bc49-40c4621b2a26 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:03:59.826421 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-099a0ed7-0395-4696-bc49-40c4621b2a26 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:03:59.832786 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-099a0ed7-0395-4696-bc49-40c4621b2a26 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:03:59.833237 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-099a0ed7-0395-4696-bc49-40c4621b2a26 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:03:59.834013 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-099a0ed7-0395-4696-bc49-40c4621b2a26 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:03:59.834447 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-099a0ed7-0395-4696-bc49-40c4621b2a26 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:03:59.964972 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-099a0ed7-0395-4696-bc49-40c4621b2a26 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:03:59.972739 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-099a0ed7-0395-4696-bc49-40c4621b2a26 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 200 len: 1576 microversion: 2.1 time: 0.151021 Nov 21 14:03:59.973299 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 544/1091] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:03:59 2021] GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:04:00.990243 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-04169451-989e-417a-88cb-f50d21744ef9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:04:00.990856 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-04169451-989e-417a-88cb-f50d21744ef9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:04:01.007699 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-04169451-989e-417a-88cb-f50d21744ef9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:01.008291 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-04169451-989e-417a-88cb-f50d21744ef9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:01.008950 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-04169451-989e-417a-88cb-f50d21744ef9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:01.009382 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-04169451-989e-417a-88cb-f50d21744ef9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:01.014606 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO oslo.messaging._drivers.impl_rabbit [-] [d819ebd3-4161-4c9c-9b8f-2b9a0b3cb916] Reconnected to AMQP server on 10.222.0.11:5672 via [amqp] client with port 35444. Nov 21 14:04:01.071223 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-04169451-989e-417a-88cb-f50d21744ef9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:04:01.082363 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-04169451-989e-417a-88cb-f50d21744ef9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 200 len: 1509 microversion: 2.1 time: 0.095708 Nov 21 14:04:01.083289 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 548/1092] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:04:00 2021] GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 1509 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:04:01.408823 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-1ec95263-5a1f-4244-a53b-b3d56643eb71 req-9ce3b444-ce00-4173-87f1-dd4104491dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9014772b-e240-4c5f-8abc-76aa454938ab", "name": "network-vif-deleted", "tag": "489a10b7-9731-4d59-9d05-a3c042350821"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:04:01.410375 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 14:04:01.410375 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 14:04:01.417539 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-1ec95263-5a1f-4244-a53b-b3d56643eb71 req-9ce3b444-ce00-4173-87f1-dd4104491dbc service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:01.417987 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-1ec95263-5a1f-4244-a53b-b3d56643eb71 req-9ce3b444-ce00-4173-87f1-dd4104491dbc service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:01.429645 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-1ec95263-5a1f-4244-a53b-b3d56643eb71 req-9ce3b444-ce00-4173-87f1-dd4104491dbc service nova] Creating event network-vif-deleted:489a10b7-9731-4d59-9d05-a3c042350821 for instance 9014772b-e240-4c5f-8abc-76aa454938ab on hv-cinder-76845 Nov 21 14:04:01.435254 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-1ec95263-5a1f-4244-a53b-b3d56643eb71 req-9ce3b444-ce00-4173-87f1-dd4104491dbc service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105955 Nov 21 14:04:01.438841 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 545/1093] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 14:04:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:04:02.100202 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-43db79c0-8240-431a-8e08-c644f44b4ab9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:04:02.100987 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-43db79c0-8240-431a-8e08-c644f44b4ab9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:04:02.108841 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-43db79c0-8240-431a-8e08-c644f44b4ab9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:02.109310 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-43db79c0-8240-431a-8e08-c644f44b4ab9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:02.110119 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-43db79c0-8240-431a-8e08-c644f44b4ab9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:02.110557 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-43db79c0-8240-431a-8e08-c644f44b4ab9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:02.144211 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-43db79c0-8240-431a-8e08-c644f44b4ab9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:02.144950 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-43db79c0-8240-431a-8e08-c644f44b4ab9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:02.145420 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.objects.instance [None req-43db79c0-8240-431a-8e08-c644f44b4ab9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lazy-loading 'fault' on Instance uuid 9014772b-e240-4c5f-8abc-76aa454938ab {{(pid=122564) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 21 14:04:02.195631 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-43db79c0-8240-431a-8e08-c644f44b4ab9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:04:02.202447 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-43db79c0-8240-431a-8e08-c644f44b4ab9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 200 len: 1183 microversion: 2.1 time: 0.106487 Nov 21 14:04:02.203025 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 549/1094] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:04:02 2021] GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 1183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:04:03.221899 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-0e2f85c8-a563-4592-ab15-5c7e2539f84a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:04:03.222604 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-0e2f85c8-a563-4592-ab15-5c7e2539f84a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:04:03.228832 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0e2f85c8-a563-4592-ab15-5c7e2539f84a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:03.229295 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0e2f85c8-a563-4592-ab15-5c7e2539f84a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:03.230079 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0e2f85c8-a563-4592-ab15-5c7e2539f84a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:03.230523 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-0e2f85c8-a563-4592-ab15-5c7e2539f84a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:03.245857 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-0e2f85c8-a563-4592-ab15-5c7e2539f84a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] HTTP exception thrown: Instance 9014772b-e240-4c5f-8abc-76aa454938ab could not be found. Nov 21 14:04:03.247066 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-0e2f85c8-a563-4592-ab15-5c7e2539f84a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Returning 404 to user: Instance 9014772b-e240-4c5f-8abc-76aa454938ab could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:04:03.247939 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-0e2f85c8-a563-4592-ab15-5c7e2539f84a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 404 len: 111 microversion: 2.1 time: 0.030721 Nov 21 14:04:03.248477 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 546/1095] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:04:03 2021] GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 21 14:04:03.294166 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-40cfadf1-ff99-436a-85b9-512e92eff34f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1632909196", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1360452644", "security_groups": [{"name": "tempest-secgroup-smoke-847620947"}], "block_device_mapping_v2": [{"uuid": "cb9464ee-00ea-4a67-a4a3-75045151ebcc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8"}]}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:04:03.401377 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.network.neutron [None req-40cfadf1-ff99-436a-85b9-512e92eff34f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] validate_networks() for [('4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', None, None, None, None, None)] {{(pid=122564) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 21 14:04:03.810258 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-40cfadf1-ff99-436a-85b9-512e92eff34f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Flavor limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 14:04:03.810682 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-40cfadf1-ff99-436a-85b9-512e92eff34f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Image limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 14:04:03.811187 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-40cfadf1-ff99-436a-85b9-512e92eff34f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Flavor pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 14:04:03.811596 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-40cfadf1-ff99-436a-85b9-512e92eff34f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Image pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 14:04:03.812039 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-40cfadf1-ff99-436a-85b9-512e92eff34f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 14:04:03.820510 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-40cfadf1-ff99-436a-85b9-512e92eff34f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:03.820962 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-40cfadf1-ff99-436a-85b9-512e92eff34f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:03.821780 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-40cfadf1-ff99-436a-85b9-512e92eff34f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:03.822213 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-40cfadf1-ff99-436a-85b9-512e92eff34f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:03.837869 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-40cfadf1-ff99-436a-85b9-512e92eff34f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Getting quotas for project db51095fd43e4fe5855207bd0ea7a651. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 14:04:03.842212 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-40cfadf1-ff99-436a-85b9-512e92eff34f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Getting quotas for user c85790f3393844f68ea138c3b6af8043 and project db51095fd43e4fe5855207bd0ea7a651. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 14:04:03.895687 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-40cfadf1-ff99-436a-85b9-512e92eff34f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Going to run 1 instances... {{(pid=122564) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 14:04:03.897857 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-40cfadf1-ff99-436a-85b9-512e92eff34f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 98c31c5e-7ef4-4ff9-a333-f27db4050a2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cb9464ee-00ea-4a67-a4a3-75045151ebcc',volume_size=None,volume_type=None)] {{(pid=122564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 14:04:04.020773 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-40cfadf1-ff99-436a-85b9-512e92eff34f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.730802 Nov 21 14:04:04.021404 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 550/1096] 10.222.0.11 () {60 vars in 1146 bytes} [Sun Nov 21 14:04:03 2021] POST /compute/v2.1/servers => generated 405 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 14:04:04.031836 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-91604250-fb35-4cdc-9734-9e9f25db2ca7 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:04:04.032559 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-91604250-fb35-4cdc-9734-9e9f25db2ca7 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 98c31c5e-7ef4-4ff9-a333-f27db4050a2e] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:04:04.086992 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-91604250-fb35-4cdc-9734-9e9f25db2ca7 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:04:04.094430 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-91604250-fb35-4cdc-9734-9e9f25db2ca7 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e" status: 200 len: 1095 microversion: 2.1 time: 0.066926 Nov 21 14:04:04.094997 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 547/1097] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:04:04 2021] GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:04:05.113652 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-faebd39c-7291-4652-bf59-167f6b5edf59 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:04:05.114266 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-faebd39c-7291-4652-bf59-167f6b5edf59 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 98c31c5e-7ef4-4ff9-a333-f27db4050a2e] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:04:05.121370 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-faebd39c-7291-4652-bf59-167f6b5edf59 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:05.121837 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-faebd39c-7291-4652-bf59-167f6b5edf59 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:05.122696 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-faebd39c-7291-4652-bf59-167f6b5edf59 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:05.123119 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-faebd39c-7291-4652-bf59-167f6b5edf59 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:05.193731 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-faebd39c-7291-4652-bf59-167f6b5edf59 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:04:05.201104 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-faebd39c-7291-4652-bf59-167f6b5edf59 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e" status: 200 len: 1201 microversion: 2.1 time: 0.091552 Nov 21 14:04:05.201672 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 551/1098] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:04:05 2021] GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e => generated 1201 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:04:06.217738 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-62b202d1-f21b-4639-8975-37b8af0cd576 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:04:06.218384 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-62b202d1-f21b-4639-8975-37b8af0cd576 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 98c31c5e-7ef4-4ff9-a333-f27db4050a2e] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:04:06.226809 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-62b202d1-f21b-4639-8975-37b8af0cd576 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:06.227258 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-62b202d1-f21b-4639-8975-37b8af0cd576 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:06.228212 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-62b202d1-f21b-4639-8975-37b8af0cd576 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:06.228513 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-62b202d1-f21b-4639-8975-37b8af0cd576 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:06.455602 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-62b202d1-f21b-4639-8975-37b8af0cd576 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:04:06.462848 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-62b202d1-f21b-4639-8975-37b8af0cd576 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e" status: 200 len: 1266 microversion: 2.1 time: 0.248780 Nov 21 14:04:06.463409 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 548/1099] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:04:06 2021] GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:04:06.774943 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-5b901b7b-9983-4812-8faf-3a1d749a7b51 req-bb35f210-ae4c-450f-bee2-86cd450a63d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98c31c5e-7ef4-4ff9-a333-f27db4050a2e", "tag": "cbc8a307-df34-44fb-9201-3c417eda1bd8"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:04:06.781268 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 14:04:06.781268 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 14:04:06.792248 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-5b901b7b-9983-4812-8faf-3a1d749a7b51 req-bb35f210-ae4c-450f-bee2-86cd450a63d8 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:06.792984 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-5b901b7b-9983-4812-8faf-3a1d749a7b51 req-bb35f210-ae4c-450f-bee2-86cd450a63d8 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:06.806538 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-5b901b7b-9983-4812-8faf-3a1d749a7b51 req-bb35f210-ae4c-450f-bee2-86cd450a63d8 service nova] Creating event network-changed:cbc8a307-df34-44fb-9201-3c417eda1bd8 for instance 98c31c5e-7ef4-4ff9-a333-f27db4050a2e on hv-cinder-76845 Nov 21 14:04:06.812195 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-5b901b7b-9983-4812-8faf-3a1d749a7b51 req-bb35f210-ae4c-450f-bee2-86cd450a63d8 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041456 Nov 21 14:04:06.813314 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 552/1100] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 14:04:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:04:07.479863 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-61860758-465f-4ffb-a070-d055a525d487 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:04:07.480482 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-61860758-465f-4ffb-a070-d055a525d487 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 98c31c5e-7ef4-4ff9-a333-f27db4050a2e] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:04:07.486735 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-61860758-465f-4ffb-a070-d055a525d487 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:07.487193 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-61860758-465f-4ffb-a070-d055a525d487 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:07.488009 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-61860758-465f-4ffb-a070-d055a525d487 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:07.488452 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-61860758-465f-4ffb-a070-d055a525d487 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:07.700865 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-61860758-465f-4ffb-a070-d055a525d487 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:04:07.708072 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-61860758-465f-4ffb-a070-d055a525d487 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e" status: 200 len: 1266 microversion: 2.1 time: 0.232003 Nov 21 14:04:07.708634 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 549/1101] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:04:07 2021] GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:04:08.725631 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-42841a12-3532-4c47-9f3c-2ee0ab6cbfed tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:04:08.726332 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-42841a12-3532-4c47-9f3c-2ee0ab6cbfed tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 98c31c5e-7ef4-4ff9-a333-f27db4050a2e] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:04:08.732422 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-42841a12-3532-4c47-9f3c-2ee0ab6cbfed tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:08.732877 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-42841a12-3532-4c47-9f3c-2ee0ab6cbfed tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:08.733653 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-42841a12-3532-4c47-9f3c-2ee0ab6cbfed tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:08.734090 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-42841a12-3532-4c47-9f3c-2ee0ab6cbfed tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:08.866128 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-42841a12-3532-4c47-9f3c-2ee0ab6cbfed tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:04:08.874254 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-42841a12-3532-4c47-9f3c-2ee0ab6cbfed tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e" status: 200 len: 1266 microversion: 2.1 time: 0.153065 Nov 21 14:04:08.874823 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 553/1102] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:04:08 2021] GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:04:09.891264 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a99a68b0-a655-479a-8ec1-27f1818d705c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:04:09.891913 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a99a68b0-a655-479a-8ec1-27f1818d705c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 98c31c5e-7ef4-4ff9-a333-f27db4050a2e] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:04:09.898378 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a99a68b0-a655-479a-8ec1-27f1818d705c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:09.898897 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a99a68b0-a655-479a-8ec1-27f1818d705c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:09.899720 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a99a68b0-a655-479a-8ec1-27f1818d705c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:09.900225 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a99a68b0-a655-479a-8ec1-27f1818d705c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:10.034124 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a99a68b0-a655-479a-8ec1-27f1818d705c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:04:10.041336 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a99a68b0-a655-479a-8ec1-27f1818d705c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e" status: 200 len: 1266 microversion: 2.1 time: 0.154335 Nov 21 14:04:10.041897 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 550/1103] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:04:09 2021] GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:04:11.058694 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-c8d1d112-227a-40a2-b6f1-48b63c821849 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:04:11.059306 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-c8d1d112-227a-40a2-b6f1-48b63c821849 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 98c31c5e-7ef4-4ff9-a333-f27db4050a2e] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:04:11.065641 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c8d1d112-227a-40a2-b6f1-48b63c821849 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:11.066089 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c8d1d112-227a-40a2-b6f1-48b63c821849 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:11.066862 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c8d1d112-227a-40a2-b6f1-48b63c821849 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:11.067594 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-c8d1d112-227a-40a2-b6f1-48b63c821849 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:11.200888 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-c8d1d112-227a-40a2-b6f1-48b63c821849 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:04:11.208028 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-c8d1d112-227a-40a2-b6f1-48b63c821849 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e" status: 200 len: 1266 microversion: 2.1 time: 0.153022 Nov 21 14:04:11.208579 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 554/1104] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:04:11 2021] GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:04:12.224503 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-c84d32bf-a261-4b72-bb5d-4b872dea4d38 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:04:12.225100 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-c84d32bf-a261-4b72-bb5d-4b872dea4d38 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 98c31c5e-7ef4-4ff9-a333-f27db4050a2e] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:04:12.231282 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c84d32bf-a261-4b72-bb5d-4b872dea4d38 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:12.231721 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c84d32bf-a261-4b72-bb5d-4b872dea4d38 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:12.232526 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c84d32bf-a261-4b72-bb5d-4b872dea4d38 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:12.232956 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-c84d32bf-a261-4b72-bb5d-4b872dea4d38 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:12.505243 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-c84d32bf-a261-4b72-bb5d-4b872dea4d38 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:04:12.512366 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-c84d32bf-a261-4b72-bb5d-4b872dea4d38 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e" status: 200 len: 1266 microversion: 2.1 time: 0.291457 Nov 21 14:04:12.512916 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 551/1105] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:04:12 2021] GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:04:13.529073 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-30bb5c89-f948-4ccb-9b57-05d6fa316001 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:04:13.529703 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-30bb5c89-f948-4ccb-9b57-05d6fa316001 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 98c31c5e-7ef4-4ff9-a333-f27db4050a2e] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:04:13.535957 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-30bb5c89-f948-4ccb-9b57-05d6fa316001 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:13.536405 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-30bb5c89-f948-4ccb-9b57-05d6fa316001 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:13.537175 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-30bb5c89-f948-4ccb-9b57-05d6fa316001 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:13.537605 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-30bb5c89-f948-4ccb-9b57-05d6fa316001 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:13.666533 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-30bb5c89-f948-4ccb-9b57-05d6fa316001 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:04:13.674387 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-30bb5c89-f948-4ccb-9b57-05d6fa316001 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e" status: 200 len: 1266 microversion: 2.1 time: 0.148989 Nov 21 14:04:13.674945 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 555/1106] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:04:13 2021] GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:04:14.691575 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-8356c452-2249-4686-a326-3bc694a589a8 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:04:14.692208 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-8356c452-2249-4686-a326-3bc694a589a8 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 98c31c5e-7ef4-4ff9-a333-f27db4050a2e] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:04:14.698352 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8356c452-2249-4686-a326-3bc694a589a8 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:14.698797 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8356c452-2249-4686-a326-3bc694a589a8 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:14.699564 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8356c452-2249-4686-a326-3bc694a589a8 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:14.700030 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8356c452-2249-4686-a326-3bc694a589a8 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:14.834395 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-8356c452-2249-4686-a326-3bc694a589a8 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:04:14.841624 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-8356c452-2249-4686-a326-3bc694a589a8 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e" status: 200 len: 1266 microversion: 2.1 time: 0.153610 Nov 21 14:04:14.842173 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 552/1107] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:04:14 2021] GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:04:15.583342 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-7eb0ccb5-2e5b-4f4f-a0e1-218ebf4e82b4 req-308ef5b1-c58a-4587-bce6-b5a2256bc9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c31c5e-7ef4-4ff9-a333-f27db4050a2e", "name": "network-vif-plugged", "status": "completed", "tag": "cbc8a307-df34-44fb-9201-3c417eda1bd8"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:04:15.584990 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 14:04:15.584990 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 14:04:15.591934 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-7eb0ccb5-2e5b-4f4f-a0e1-218ebf4e82b4 req-308ef5b1-c58a-4587-bce6-b5a2256bc9b4 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:15.592382 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-7eb0ccb5-2e5b-4f4f-a0e1-218ebf4e82b4 req-308ef5b1-c58a-4587-bce6-b5a2256bc9b4 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:15.602964 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-7eb0ccb5-2e5b-4f4f-a0e1-218ebf4e82b4 req-308ef5b1-c58a-4587-bce6-b5a2256bc9b4 service nova] Creating event network-vif-plugged:cbc8a307-df34-44fb-9201-3c417eda1bd8 for instance 98c31c5e-7ef4-4ff9-a333-f27db4050a2e on hv-cinder-76845 Nov 21 14:04:15.607835 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-7eb0ccb5-2e5b-4f4f-a0e1-218ebf4e82b4 req-308ef5b1-c58a-4587-bce6-b5a2256bc9b4 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090423 Nov 21 14:04:15.608426 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 556/1108] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 14:04:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:04:15.858808 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-a6289401-a6d2-4972-a756-c2c2d93f7d41 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:04:15.859431 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-a6289401-a6d2-4972-a756-c2c2d93f7d41 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 98c31c5e-7ef4-4ff9-a333-f27db4050a2e] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:04:15.865757 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a6289401-a6d2-4972-a756-c2c2d93f7d41 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:15.866216 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a6289401-a6d2-4972-a756-c2c2d93f7d41 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:15.867039 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a6289401-a6d2-4972-a756-c2c2d93f7d41 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:15.867489 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-a6289401-a6d2-4972-a756-c2c2d93f7d41 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:16.003549 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-a6289401-a6d2-4972-a756-c2c2d93f7d41 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:04:16.010819 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-a6289401-a6d2-4972-a756-c2c2d93f7d41 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e" status: 200 len: 1266 microversion: 2.1 time: 0.156262 Nov 21 14:04:16.011706 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 553/1109] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:04:15 2021] GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:04:17.029503 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-f87b4a3f-62f1-45b8-bca0-1f322317d228 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:04:17.030787 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-f87b4a3f-62f1-45b8-bca0-1f322317d228 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 98c31c5e-7ef4-4ff9-a333-f27db4050a2e] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:04:17.036865 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f87b4a3f-62f1-45b8-bca0-1f322317d228 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:17.037326 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f87b4a3f-62f1-45b8-bca0-1f322317d228 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:17.038113 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f87b4a3f-62f1-45b8-bca0-1f322317d228 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:17.038552 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f87b4a3f-62f1-45b8-bca0-1f322317d228 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:17.178822 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-f87b4a3f-62f1-45b8-bca0-1f322317d228 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:04:17.186309 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-f87b4a3f-62f1-45b8-bca0-1f322317d228 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e" status: 200 len: 1266 microversion: 2.1 time: 0.161263 Nov 21 14:04:17.186893 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 557/1110] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:04:17 2021] GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 14:04:18.202992 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ec4a6fef-babb-42c2-b536-23497028e893 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:04:18.203621 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ec4a6fef-babb-42c2-b536-23497028e893 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 98c31c5e-7ef4-4ff9-a333-f27db4050a2e] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:04:18.209842 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ec4a6fef-babb-42c2-b536-23497028e893 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:18.210291 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ec4a6fef-babb-42c2-b536-23497028e893 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:18.211069 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ec4a6fef-babb-42c2-b536-23497028e893 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:18.211501 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ec4a6fef-babb-42c2-b536-23497028e893 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:18.341508 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ec4a6fef-babb-42c2-b536-23497028e893 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:04:18.348718 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ec4a6fef-babb-42c2-b536-23497028e893 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e" status: 200 len: 1454 microversion: 2.1 time: 0.149414 Nov 21 14:04:18.349270 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 554/1111] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:04:18 2021] GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:04:18.364957 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-e18fb084-570e-475a-8bbd-8a8e65b9abec tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:04:18.365569 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-e18fb084-570e-475a-8bbd-8a8e65b9abec tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 98c31c5e-7ef4-4ff9-a333-f27db4050a2e] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:04:18.372037 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e18fb084-570e-475a-8bbd-8a8e65b9abec tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:18.372467 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e18fb084-570e-475a-8bbd-8a8e65b9abec tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:18.373264 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e18fb084-570e-475a-8bbd-8a8e65b9abec tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:18.373700 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-e18fb084-570e-475a-8bbd-8a8e65b9abec tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:18.504709 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-e18fb084-570e-475a-8bbd-8a8e65b9abec tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:04:18.516671 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-e18fb084-570e-475a-8bbd-8a8e65b9abec tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e" status: 200 len: 1454 microversion: 2.1 time: 0.155329 Nov 21 14:04:18.518890 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 558/1112] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:04:18 2021] GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:04:20.142516 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-87dc9c14-77fc-4fb6-a580-1a363e790f3a req-c978d28d-cd19-4f65-b01c-a7dc64fdb6ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98c31c5e-7ef4-4ff9-a333-f27db4050a2e", "tag": "cbc8a307-df34-44fb-9201-3c417eda1bd8"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:04:20.144094 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 14:04:20.144094 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 14:04:20.150952 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-87dc9c14-77fc-4fb6-a580-1a363e790f3a req-c978d28d-cd19-4f65-b01c-a7dc64fdb6ff service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:04:20.151399 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-87dc9c14-77fc-4fb6-a580-1a363e790f3a req-c978d28d-cd19-4f65-b01c-a7dc64fdb6ff service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:04:20.164393 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-87dc9c14-77fc-4fb6-a580-1a363e790f3a req-c978d28d-cd19-4f65-b01c-a7dc64fdb6ff service nova] Creating event network-changed:cbc8a307-df34-44fb-9201-3c417eda1bd8 for instance 98c31c5e-7ef4-4ff9-a333-f27db4050a2e on hv-cinder-76845 Nov 21 14:04:20.170001 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-87dc9c14-77fc-4fb6-a580-1a363e790f3a req-c978d28d-cd19-4f65-b01c-a7dc64fdb6ff service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089900 Nov 21 14:04:20.170726 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 555/1113] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 14:04:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:05:10.421613 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 14:05:10.422175 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: Sun Nov 21 14:05:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 14:05:55.282735 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-226532853", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1360452644", "security_groups": [{"name": "tempest-secgroup-smoke-847620947"}], "block_device_mapping_v2": [{"uuid": "2fabcc2c-ae75-4194-b18e-4e462e749f7b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8"}]}} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:05:55.390664 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.network.neutron [None req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] validate_networks() for [('4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', None, None, None, None, None)] {{(pid=122564) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 21 14:05:55.747465 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Flavor limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 14:05:55.747945 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Image limits 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 14:05:55.748427 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Flavor pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 14:05:55.748866 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Image pref 0:0:0 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 14:05:55.749278 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.virt.hardware [None req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122564) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 14:05:55.757771 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:05:55.758222 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:05:55.759035 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:05:55.759472 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:05:55.777236 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Getting quotas for project db51095fd43e4fe5855207bd0ea7a651. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 14:05:55.782747 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.quota [None req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Getting quotas for user c85790f3393844f68ea138c3b6af8043 and project db51095fd43e4fe5855207bd0ea7a651. Resources: {'instances', 'ram', 'cores'} {{(pid=122564) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 14:05:55.836144 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Going to run 1 instances... {{(pid=122564) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 14:05:55.838276 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2fabcc2c-ae75-4194-b18e-4e462e749f7b',volume_size=None,volume_type=None)] {{(pid=122564) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 14:05:55.959408 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.681511 Nov 21 14:05:55.960242 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 559/1114] 10.222.0.11 () {60 vars in 1146 bytes} [Sun Nov 21 14:05:55 2021] POST /compute/v2.1/servers => generated 405 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 14:05:55.972278 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-94eba4ca-0a17-47de-8a6a-8a2fb5cac4b8 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:05:55.972975 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-94eba4ca-0a17-47de-8a6a-8a2fb5cac4b8 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:05:56.026846 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-94eba4ca-0a17-47de-8a6a-8a2fb5cac4b8 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:05:56.033261 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-94eba4ca-0a17-47de-8a6a-8a2fb5cac4b8 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7" status: 200 len: 1094 microversion: 2.1 time: 0.066882 Nov 21 14:05:56.033846 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 556/1115] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:05:55 2021] GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:05:57.050523 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-baafd677-2a91-4cb2-8a19-0474b2cd8489 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:05:57.051143 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-baafd677-2a91-4cb2-8a19-0474b2cd8489 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:05:57.057699 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-baafd677-2a91-4cb2-8a19-0474b2cd8489 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:05:57.058165 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-baafd677-2a91-4cb2-8a19-0474b2cd8489 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:05:57.058952 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-baafd677-2a91-4cb2-8a19-0474b2cd8489 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:05:57.059392 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-baafd677-2a91-4cb2-8a19-0474b2cd8489 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:05:57.132568 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-baafd677-2a91-4cb2-8a19-0474b2cd8489 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:05:57.140035 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-baafd677-2a91-4cb2-8a19-0474b2cd8489 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7" status: 200 len: 1192 microversion: 2.1 time: 0.093671 Nov 21 14:05:57.141159 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 560/1116] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:05:57 2021] GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7 => generated 1192 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:05:58.157947 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-8920ce2a-fa9d-4a5f-8c75-0da4f9aef1fb tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:05:58.158555 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-8920ce2a-fa9d-4a5f-8c75-0da4f9aef1fb tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:05:58.165851 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8920ce2a-fa9d-4a5f-8c75-0da4f9aef1fb tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:05:58.166381 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8920ce2a-fa9d-4a5f-8c75-0da4f9aef1fb tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:05:58.167166 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8920ce2a-fa9d-4a5f-8c75-0da4f9aef1fb tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:05:58.167596 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-8920ce2a-fa9d-4a5f-8c75-0da4f9aef1fb tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:05:58.384384 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-8920ce2a-fa9d-4a5f-8c75-0da4f9aef1fb tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:05:58.393238 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-8920ce2a-fa9d-4a5f-8c75-0da4f9aef1fb tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7" status: 200 len: 1265 microversion: 2.1 time: 0.238916 Nov 21 14:05:58.394166 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 557/1117] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:05:58 2021] GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:05:58.588735 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-58e6de6e-1a4e-42e6-aaec-79d9b04faa96 req-4c0724e9-09b4-4aa3-8381-53a25a1e98e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1153565e-8e49-4741-9f8c-52876f41f5f7", "tag": "549d8b87-c3cf-4a17-bfa0-15421b9689ff"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:05:58.590327 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 14:05:58.590327 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 14:05:58.598657 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-58e6de6e-1a4e-42e6-aaec-79d9b04faa96 req-4c0724e9-09b4-4aa3-8381-53a25a1e98e9 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:05:58.599232 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-58e6de6e-1a4e-42e6-aaec-79d9b04faa96 req-4c0724e9-09b4-4aa3-8381-53a25a1e98e9 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:05:58.617419 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-58e6de6e-1a4e-42e6-aaec-79d9b04faa96 req-4c0724e9-09b4-4aa3-8381-53a25a1e98e9 service nova] Creating event network-changed:549d8b87-c3cf-4a17-bfa0-15421b9689ff for instance 1153565e-8e49-4741-9f8c-52876f41f5f7 on hv-cinder-76845 Nov 21 14:05:58.622532 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-58e6de6e-1a4e-42e6-aaec-79d9b04faa96 req-4c0724e9-09b4-4aa3-8381-53a25a1e98e9 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037549 Nov 21 14:05:58.623138 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 561/1118] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 14:05:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:05:59.410990 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-4e762caf-9eca-4615-a67e-c05aa77d4c53 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:05:59.412975 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-4e762caf-9eca-4615-a67e-c05aa77d4c53 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:05:59.420636 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4e762caf-9eca-4615-a67e-c05aa77d4c53 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:05:59.421085 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4e762caf-9eca-4615-a67e-c05aa77d4c53 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:05:59.421999 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4e762caf-9eca-4615-a67e-c05aa77d4c53 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:05:59.422457 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-4e762caf-9eca-4615-a67e-c05aa77d4c53 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:05:59.625569 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-4e762caf-9eca-4615-a67e-c05aa77d4c53 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:05:59.632853 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-4e762caf-9eca-4615-a67e-c05aa77d4c53 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7" status: 200 len: 1265 microversion: 2.1 time: 0.226351 Nov 21 14:05:59.633414 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 558/1119] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:05:59 2021] GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:06:00.650070 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-3780de7f-e00f-4a45-8927-bec12b2f939c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:06:00.650768 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-3780de7f-e00f-4a45-8927-bec12b2f939c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:06:00.657377 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3780de7f-e00f-4a45-8927-bec12b2f939c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:00.657834 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3780de7f-e00f-4a45-8927-bec12b2f939c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:00.658612 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3780de7f-e00f-4a45-8927-bec12b2f939c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:00.659047 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-3780de7f-e00f-4a45-8927-bec12b2f939c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:00.790740 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-3780de7f-e00f-4a45-8927-bec12b2f939c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:06:00.798513 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-3780de7f-e00f-4a45-8927-bec12b2f939c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7" status: 200 len: 1265 microversion: 2.1 time: 0.153031 Nov 21 14:06:00.799067 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 562/1120] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:06:00 2021] GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:06:01.817635 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-e307a2e1-5059-4c8a-9dff-a12997f6216b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:06:01.818418 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-e307a2e1-5059-4c8a-9dff-a12997f6216b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:06:01.824785 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e307a2e1-5059-4c8a-9dff-a12997f6216b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:01.825230 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e307a2e1-5059-4c8a-9dff-a12997f6216b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:01.826003 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e307a2e1-5059-4c8a-9dff-a12997f6216b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:01.826489 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-e307a2e1-5059-4c8a-9dff-a12997f6216b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:01.957656 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-e307a2e1-5059-4c8a-9dff-a12997f6216b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:06:01.964866 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-e307a2e1-5059-4c8a-9dff-a12997f6216b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7" status: 200 len: 1265 microversion: 2.1 time: 0.153563 Nov 21 14:06:01.965417 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 559/1121] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:06:01 2021] GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:06:02.982367 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-f0f5f635-6aff-4612-ae7c-8bf512ff8503 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:06:02.982908 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-f0f5f635-6aff-4612-ae7c-8bf512ff8503 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:06:02.989321 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f0f5f635-6aff-4612-ae7c-8bf512ff8503 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:02.989771 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f0f5f635-6aff-4612-ae7c-8bf512ff8503 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:02.990537 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f0f5f635-6aff-4612-ae7c-8bf512ff8503 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:02.990967 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-f0f5f635-6aff-4612-ae7c-8bf512ff8503 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:03.122523 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-f0f5f635-6aff-4612-ae7c-8bf512ff8503 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:06:03.133968 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-f0f5f635-6aff-4612-ae7c-8bf512ff8503 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7" status: 200 len: 1265 microversion: 2.1 time: 0.155499 Nov 21 14:06:03.135198 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 563/1122] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:06:02 2021] GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:06:04.151683 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-f8f561ff-9362-4006-8e3a-a3fbc6519990 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:06:04.152304 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-f8f561ff-9362-4006-8e3a-a3fbc6519990 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:06:04.158200 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f8f561ff-9362-4006-8e3a-a3fbc6519990 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:04.158650 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f8f561ff-9362-4006-8e3a-a3fbc6519990 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:04.159423 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f8f561ff-9362-4006-8e3a-a3fbc6519990 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:04.159883 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-f8f561ff-9362-4006-8e3a-a3fbc6519990 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:04.287285 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-f8f561ff-9362-4006-8e3a-a3fbc6519990 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:06:04.294493 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-f8f561ff-9362-4006-8e3a-a3fbc6519990 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7" status: 200 len: 1265 microversion: 2.1 time: 0.146650 Nov 21 14:06:04.295034 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 560/1123] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:06:04 2021] GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:06:05.310208 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-d4ad6c1d-e168-4873-9e3f-abca24a6e7e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:06:05.310831 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-d4ad6c1d-e168-4873-9e3f-abca24a6e7e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:06:05.317104 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d4ad6c1d-e168-4873-9e3f-abca24a6e7e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:05.317555 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d4ad6c1d-e168-4873-9e3f-abca24a6e7e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:05.318333 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d4ad6c1d-e168-4873-9e3f-abca24a6e7e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:05.318772 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-d4ad6c1d-e168-4873-9e3f-abca24a6e7e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:05.446439 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-d4ad6c1d-e168-4873-9e3f-abca24a6e7e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:06:05.454211 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-d4ad6c1d-e168-4873-9e3f-abca24a6e7e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7" status: 200 len: 1265 microversion: 2.1 time: 0.147789 Nov 21 14:06:05.454777 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 564/1124] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:06:05 2021] GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:06:06.471310 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-55738a00-d672-4e2b-9d74-0962c019e082 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:06:06.471941 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-55738a00-d672-4e2b-9d74-0962c019e082 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:06:06.478113 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-55738a00-d672-4e2b-9d74-0962c019e082 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:06.478560 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-55738a00-d672-4e2b-9d74-0962c019e082 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:06.479328 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-55738a00-d672-4e2b-9d74-0962c019e082 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:06.479759 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-55738a00-d672-4e2b-9d74-0962c019e082 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:06.605548 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-55738a00-d672-4e2b-9d74-0962c019e082 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:06:06.613291 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-55738a00-d672-4e2b-9d74-0962c019e082 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7" status: 200 len: 1265 microversion: 2.1 time: 0.146126 Nov 21 14:06:06.613848 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 561/1125] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:06:06 2021] GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:06:07.630160 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-9717eac0-94d7-46e1-b1a5-552dd6cc3286 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:06:07.630733 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-9717eac0-94d7-46e1-b1a5-552dd6cc3286 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:06:07.637044 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9717eac0-94d7-46e1-b1a5-552dd6cc3286 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:07.637499 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9717eac0-94d7-46e1-b1a5-552dd6cc3286 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:07.638277 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9717eac0-94d7-46e1-b1a5-552dd6cc3286 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:07.638710 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-9717eac0-94d7-46e1-b1a5-552dd6cc3286 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:07.770637 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-9717eac0-94d7-46e1-b1a5-552dd6cc3286 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:06:07.777868 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-9717eac0-94d7-46e1-b1a5-552dd6cc3286 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7" status: 200 len: 1265 microversion: 2.1 time: 0.151423 Nov 21 14:06:07.778423 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 565/1126] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:06:07 2021] GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:06:08.794087 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-3b1736db-1696-4025-856a-ac628d41e630 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:06:08.794696 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-3b1736db-1696-4025-856a-ac628d41e630 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:06:08.800952 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3b1736db-1696-4025-856a-ac628d41e630 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:08.801400 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3b1736db-1696-4025-856a-ac628d41e630 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:08.802171 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3b1736db-1696-4025-856a-ac628d41e630 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:08.802605 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-3b1736db-1696-4025-856a-ac628d41e630 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:09.195075 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-3b1736db-1696-4025-856a-ac628d41e630 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:06:09.202220 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-3b1736db-1696-4025-856a-ac628d41e630 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7" status: 200 len: 1265 microversion: 2.1 time: 0.411757 Nov 21 14:06:09.202763 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 562/1127] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:06:08 2021] GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7 => generated 1265 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:06:10.188239 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [req-8cf547cc-c02d-46b1-9133-43da6fd5f53a req-f7e31416-7380-431d-8489-764e4937514d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1153565e-8e49-4741-9f8c-52876f41f5f7", "name": "network-vif-plugged", "status": "completed", "tag": "549d8b87-c3cf-4a17-bfa0-15421b9689ff"}]} {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:06:10.189838 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 14:06:10.189838 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: warnings.warn(msg) Nov 21 14:06:10.197577 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-8cf547cc-c02d-46b1-9133-43da6fd5f53a req-f7e31416-7380-431d-8489-764e4937514d service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:10.198031 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [req-8cf547cc-c02d-46b1-9133-43da6fd5f53a req-f7e31416-7380-431d-8489-764e4937514d service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:10.208826 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.compute.server_external_events [req-8cf547cc-c02d-46b1-9133-43da6fd5f53a req-f7e31416-7380-431d-8489-764e4937514d service nova] Creating event network-vif-plugged:549d8b87-c3cf-4a17-bfa0-15421b9689ff for instance 1153565e-8e49-4741-9f8c-52876f41f5f7 on hv-cinder-76845 Nov 21 14:06:10.213759 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [req-8cf547cc-c02d-46b1-9133-43da6fd5f53a req-f7e31416-7380-431d-8489-764e4937514d service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029410 Nov 21 14:06:10.214507 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 566/1128] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 14:06:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:06:10.219890 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-ca1218dd-fafb-41ec-9cfd-23b9296019ca tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:06:10.220763 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-ca1218dd-fafb-41ec-9cfd-23b9296019ca tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:06:10.228598 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ca1218dd-fafb-41ec-9cfd-23b9296019ca tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:10.229044 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ca1218dd-fafb-41ec-9cfd-23b9296019ca tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:10.229833 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ca1218dd-fafb-41ec-9cfd-23b9296019ca tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:10.230261 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-ca1218dd-fafb-41ec-9cfd-23b9296019ca tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:10.366862 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-ca1218dd-fafb-41ec-9cfd-23b9296019ca tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:06:10.374551 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-ca1218dd-fafb-41ec-9cfd-23b9296019ca tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7" status: 200 len: 1265 microversion: 2.1 time: 0.159123 Nov 21 14:06:10.375106 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 563/1129] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:06:10 2021] GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 14:06:11.392725 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-62e4bffd-3ec5-498b-82b1-38f5090eab8f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:06:11.393433 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-62e4bffd-3ec5-498b-82b1-38f5090eab8f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:06:11.399843 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-62e4bffd-3ec5-498b-82b1-38f5090eab8f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:11.400299 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-62e4bffd-3ec5-498b-82b1-38f5090eab8f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:11.401107 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-62e4bffd-3ec5-498b-82b1-38f5090eab8f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:11.401547 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-62e4bffd-3ec5-498b-82b1-38f5090eab8f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:11.545914 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-62e4bffd-3ec5-498b-82b1-38f5090eab8f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:06:11.553376 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-62e4bffd-3ec5-498b-82b1-38f5090eab8f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7" status: 200 len: 1265 microversion: 2.1 time: 0.165720 Nov 21 14:06:11.554079 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 567/1130] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:06:11 2021] GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:06:12.570212 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-30e52cd5-f57d-4e02-a613-33097f6d4727 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:06:12.570747 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-30e52cd5-f57d-4e02-a613-33097f6d4727 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:06:12.576924 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-30e52cd5-f57d-4e02-a613-33097f6d4727 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:12.577376 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-30e52cd5-f57d-4e02-a613-33097f6d4727 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:12.578151 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-30e52cd5-f57d-4e02-a613-33097f6d4727 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:12.579134 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-30e52cd5-f57d-4e02-a613-33097f6d4727 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:12.704850 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-30e52cd5-f57d-4e02-a613-33097f6d4727 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:06:12.712010 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-30e52cd5-f57d-4e02-a613-33097f6d4727 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7" status: 200 len: 1453 microversion: 2.1 time: 0.145487 Nov 21 14:06:12.712555 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 564/1131] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:06:12 2021] GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7 => generated 1453 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:06:12.727768 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-8043cae3-4038-48a3-b0ed-9eb9a700e6f7 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:06:12.728415 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-8043cae3-4038-48a3-b0ed-9eb9a700e6f7 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:06:12.735322 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8043cae3-4038-48a3-b0ed-9eb9a700e6f7 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:12.735767 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8043cae3-4038-48a3-b0ed-9eb9a700e6f7 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:12.736571 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8043cae3-4038-48a3-b0ed-9eb9a700e6f7 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:12.737005 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-8043cae3-4038-48a3-b0ed-9eb9a700e6f7 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:12.863387 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-8043cae3-4038-48a3-b0ed-9eb9a700e6f7 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:06:12.870939 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-8043cae3-4038-48a3-b0ed-9eb9a700e6f7 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7" status: 200 len: 1453 microversion: 2.1 time: 0.146855 Nov 21 14:06:12.871493 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 568/1132] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:06:12 2021] GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:06:14.661173 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-c4a503da-6ebf-4c93-a070-f147ae18932f req-b544adc4-893b-453e-9f3b-5e545fb6bc0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1153565e-8e49-4741-9f8c-52876f41f5f7", "tag": "549d8b87-c3cf-4a17-bfa0-15421b9689ff"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:06:14.663021 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 14:06:14.663021 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 14:06:14.670918 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-c4a503da-6ebf-4c93-a070-f147ae18932f req-b544adc4-893b-453e-9f3b-5e545fb6bc0b service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:06:14.671360 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-c4a503da-6ebf-4c93-a070-f147ae18932f req-b544adc4-893b-453e-9f3b-5e545fb6bc0b service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:06:14.682116 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-c4a503da-6ebf-4c93-a070-f147ae18932f req-b544adc4-893b-453e-9f3b-5e545fb6bc0b service nova] Creating event network-changed:549d8b87-c3cf-4a17-bfa0-15421b9689ff for instance 1153565e-8e49-4741-9f8c-52876f41f5f7 on hv-cinder-76845 Nov 21 14:06:14.688679 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-c4a503da-6ebf-4c93-a070-f147ae18932f req-b544adc4-893b-453e-9f3b-5e545fb6bc0b service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030242 Nov 21 14:06:14.689268 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 565/1133] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 14:06:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:06:57.224997 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 14:06:57.225649 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: Sun Nov 21 14:06:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 14:07:09.602064 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 14:07:09.602637 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: Sun Nov 21 14:07:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 14:07:42.855090 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-44c795ce-5634-49cc-ab0e-9c19d3f7030b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:07:42.855615 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-44c795ce-5634-49cc-ab0e-9c19d3f7030b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:07:42.858259 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-e3c07dc0-ec11-444b-acb5-bf1957528764 req-0aebaec8-405e-449d-8cf4-4750f6a3346d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1153565e-8e49-4741-9f8c-52876f41f5f7", "tag": "549d8b87-c3cf-4a17-bfa0-15421b9689ff"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:07:42.859818 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 14:07:42.859818 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 14:07:42.863012 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-44c795ce-5634-49cc-ab0e-9c19d3f7030b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:42.863467 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-44c795ce-5634-49cc-ab0e-9c19d3f7030b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:42.864292 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-44c795ce-5634-49cc-ab0e-9c19d3f7030b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:42.864735 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-44c795ce-5634-49cc-ab0e-9c19d3f7030b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:42.868088 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-e3c07dc0-ec11-444b-acb5-bf1957528764 req-0aebaec8-405e-449d-8cf4-4750f6a3346d service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:42.868597 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-e3c07dc0-ec11-444b-acb5-bf1957528764 req-0aebaec8-405e-449d-8cf4-4750f6a3346d service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:42.882258 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-e3c07dc0-ec11-444b-acb5-bf1957528764 req-0aebaec8-405e-449d-8cf4-4750f6a3346d service nova] Creating event network-changed:549d8b87-c3cf-4a17-bfa0-15421b9689ff for instance 1153565e-8e49-4741-9f8c-52876f41f5f7 on hv-cinder-76845 Nov 21 14:07:42.887831 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-e3c07dc0-ec11-444b-acb5-bf1957528764 req-0aebaec8-405e-449d-8cf4-4750f6a3346d service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034292 Nov 21 14:07:42.888953 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 566/1134] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 14:07:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:07:42.893195 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-44c795ce-5634-49cc-ab0e-9c19d3f7030b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] Going to try to terminate instance {{(pid=122564) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 21 14:07:42.978364 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-44c795ce-5634-49cc-ab0e-9c19d3f7030b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "DELETE /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7" status: 204 len: 0 microversion: 2.1 time: 0.127707 Nov 21 14:07:42.979007 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 569/1135] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 14:07:42 2021] DELETE /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:07:42.989418 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-2bcc60fe-7ed3-4d48-aca0-d84f54aab67b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:07:42.990505 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-2bcc60fe-7ed3-4d48-aca0-d84f54aab67b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:07:42.997122 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2bcc60fe-7ed3-4d48-aca0-d84f54aab67b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:42.997789 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2bcc60fe-7ed3-4d48-aca0-d84f54aab67b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:42.998577 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2bcc60fe-7ed3-4d48-aca0-d84f54aab67b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:42.999011 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-2bcc60fe-7ed3-4d48-aca0-d84f54aab67b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:43.294947 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-2bcc60fe-7ed3-4d48-aca0-d84f54aab67b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:07:43.302360 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-2bcc60fe-7ed3-4d48-aca0-d84f54aab67b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7" status: 200 len: 1577 microversion: 2.1 time: 0.317670 Nov 21 14:07:43.303168 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 567/1136] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:07:42 2021] GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7 => generated 1577 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:07:44.320924 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-2631008d-ef8a-4a31-9554-cd185ca0b941 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:07:44.321631 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-2631008d-ef8a-4a31-9554-cd185ca0b941 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:07:44.328014 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2631008d-ef8a-4a31-9554-cd185ca0b941 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:44.328469 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2631008d-ef8a-4a31-9554-cd185ca0b941 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:44.329250 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2631008d-ef8a-4a31-9554-cd185ca0b941 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:44.329688 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-2631008d-ef8a-4a31-9554-cd185ca0b941 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:44.504342 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-2631008d-ef8a-4a31-9554-cd185ca0b941 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:07:44.511603 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-2631008d-ef8a-4a31-9554-cd185ca0b941 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7" status: 200 len: 1459 microversion: 2.1 time: 0.194757 Nov 21 14:07:44.512176 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 570/1137] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:07:44 2021] GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7 => generated 1459 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:07:45.328262 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-1fdd7112-b52d-492f-97db-a66d16aac527 req-fa8affe0-532a-4c71-954a-a03b9c83ee46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1153565e-8e49-4741-9f8c-52876f41f5f7", "name": "network-vif-deleted", "tag": "549d8b87-c3cf-4a17-bfa0-15421b9689ff"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:07:45.329875 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 14:07:45.329875 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 14:07:45.338126 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-1fdd7112-b52d-492f-97db-a66d16aac527 req-fa8affe0-532a-4c71-954a-a03b9c83ee46 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:45.338580 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-1fdd7112-b52d-492f-97db-a66d16aac527 req-fa8affe0-532a-4c71-954a-a03b9c83ee46 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:45.349510 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-1fdd7112-b52d-492f-97db-a66d16aac527 req-fa8affe0-532a-4c71-954a-a03b9c83ee46 service nova] Creating event network-vif-deleted:549d8b87-c3cf-4a17-bfa0-15421b9689ff for instance 1153565e-8e49-4741-9f8c-52876f41f5f7 on hv-cinder-76845 Nov 21 14:07:45.354926 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-1fdd7112-b52d-492f-97db-a66d16aac527 req-fa8affe0-532a-4c71-954a-a03b9c83ee46 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030323 Nov 21 14:07:45.355509 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 568/1138] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 14:07:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:07:45.529370 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-366586ff-0735-4e2b-bc5c-c081bcf95829 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:07:45.529947 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-366586ff-0735-4e2b-bc5c-c081bcf95829 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:07:45.536479 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-366586ff-0735-4e2b-bc5c-c081bcf95829 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:45.536927 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-366586ff-0735-4e2b-bc5c-c081bcf95829 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:45.537754 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-366586ff-0735-4e2b-bc5c-c081bcf95829 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:45.538184 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-366586ff-0735-4e2b-bc5c-c081bcf95829 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:45.610044 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-366586ff-0735-4e2b-bc5c-c081bcf95829 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:07:45.618580 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-366586ff-0735-4e2b-bc5c-c081bcf95829 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7" status: 200 len: 1225 microversion: 2.1 time: 0.092551 Nov 21 14:07:45.619155 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 571/1139] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:07:45 2021] GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:07:46.636854 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-543bd3da-ea03-43ac-939d-cbf5dc9094ea tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:07:46.637481 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-543bd3da-ea03-43ac-939d-cbf5dc9094ea tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 1153565e-8e49-4741-9f8c-52876f41f5f7] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:07:46.643600 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-543bd3da-ea03-43ac-939d-cbf5dc9094ea tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:46.644126 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-543bd3da-ea03-43ac-939d-cbf5dc9094ea tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:46.644908 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-543bd3da-ea03-43ac-939d-cbf5dc9094ea tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:46.645511 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-543bd3da-ea03-43ac-939d-cbf5dc9094ea tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:46.658328 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-543bd3da-ea03-43ac-939d-cbf5dc9094ea tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] HTTP exception thrown: Instance 1153565e-8e49-4741-9f8c-52876f41f5f7 could not be found. Nov 21 14:07:46.658919 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-543bd3da-ea03-43ac-939d-cbf5dc9094ea tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Returning 404 to user: Instance 1153565e-8e49-4741-9f8c-52876f41f5f7 could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:07:46.659732 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-543bd3da-ea03-43ac-939d-cbf5dc9094ea tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7" status: 404 len: 111 microversion: 2.1 time: 0.027559 Nov 21 14:07:46.660279 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 569/1140] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:07:46 2021] GET /compute/v2.1/servers/1153565e-8e49-4741-9f8c-52876f41f5f7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:07:49.908073 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b5e4c484-844d-4118-bb65-e7ae1e79c06b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:07:49.908585 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b5e4c484-844d-4118-bb65-e7ae1e79c06b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 98c31c5e-7ef4-4ff9-a333-f27db4050a2e] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:07:49.912305 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-9c394cb9-8f31-449e-a8e9-34d45c674dd1 req-b51f8b0d-b2b6-4102-b48b-8f8f60d05ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98c31c5e-7ef4-4ff9-a333-f27db4050a2e", "tag": "cbc8a307-df34-44fb-9201-3c417eda1bd8"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:07:49.914603 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 14:07:49.914603 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 14:07:49.917039 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b5e4c484-844d-4118-bb65-e7ae1e79c06b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:49.917515 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b5e4c484-844d-4118-bb65-e7ae1e79c06b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:49.918611 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b5e4c484-844d-4118-bb65-e7ae1e79c06b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:49.918788 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b5e4c484-844d-4118-bb65-e7ae1e79c06b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:49.923396 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-9c394cb9-8f31-449e-a8e9-34d45c674dd1 req-b51f8b0d-b2b6-4102-b48b-8f8f60d05ad2 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:49.924446 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-9c394cb9-8f31-449e-a8e9-34d45c674dd1 req-b51f8b0d-b2b6-4102-b48b-8f8f60d05ad2 service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:49.935821 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-9c394cb9-8f31-449e-a8e9-34d45c674dd1 req-b51f8b0d-b2b6-4102-b48b-8f8f60d05ad2 service nova] Creating event network-changed:cbc8a307-df34-44fb-9201-3c417eda1bd8 for instance 98c31c5e-7ef4-4ff9-a333-f27db4050a2e on hv-cinder-76845 Nov 21 14:07:49.941664 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-9c394cb9-8f31-449e-a8e9-34d45c674dd1 req-b51f8b0d-b2b6-4102-b48b-8f8f60d05ad2 service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033961 Nov 21 14:07:49.942657 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 570/1141] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 14:07:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:07:49.946130 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b5e4c484-844d-4118-bb65-e7ae1e79c06b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 98c31c5e-7ef4-4ff9-a333-f27db4050a2e] Going to try to terminate instance {{(pid=122564) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 21 14:07:50.029360 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-b5e4c484-844d-4118-bb65-e7ae1e79c06b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "DELETE /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e" status: 204 len: 0 microversion: 2.1 time: 0.124867 Nov 21 14:07:50.030197 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 572/1142] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 14:07:49 2021] DELETE /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 14:07:50.038690 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-92469ad8-41db-437d-8cc9-0221e3bb3110 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:07:50.039579 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-92469ad8-41db-437d-8cc9-0221e3bb3110 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 98c31c5e-7ef4-4ff9-a333-f27db4050a2e] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:07:50.047605 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-92469ad8-41db-437d-8cc9-0221e3bb3110 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:50.048106 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-92469ad8-41db-437d-8cc9-0221e3bb3110 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:50.049450 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-92469ad8-41db-437d-8cc9-0221e3bb3110 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:50.049896 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-92469ad8-41db-437d-8cc9-0221e3bb3110 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:50.285449 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.policy [None req-92469ad8-41db-437d-8cc9-0221e3bb3110 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122565) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:07:50.293070 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-92469ad8-41db-437d-8cc9-0221e3bb3110 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e" status: 200 len: 1579 microversion: 2.1 time: 0.258703 Nov 21 14:07:50.293648 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 571/1143] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:07:50 2021] GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e => generated 1579 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:07:51.311456 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-b86c6da2-3876-47ac-b7b0-c5d75f68d28c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:07:51.312175 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-b86c6da2-3876-47ac-b7b0-c5d75f68d28c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 98c31c5e-7ef4-4ff9-a333-f27db4050a2e] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:07:51.319250 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b86c6da2-3876-47ac-b7b0-c5d75f68d28c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:51.319704 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b86c6da2-3876-47ac-b7b0-c5d75f68d28c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:51.320517 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b86c6da2-3876-47ac-b7b0-c5d75f68d28c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:51.320979 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-b86c6da2-3876-47ac-b7b0-c5d75f68d28c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:51.454980 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-b86c6da2-3876-47ac-b7b0-c5d75f68d28c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:07:51.462246 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-b86c6da2-3876-47ac-b7b0-c5d75f68d28c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e" status: 200 len: 1460 microversion: 2.1 time: 0.154833 Nov 21 14:07:51.462813 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 573/1144] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:07:51 2021] GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e => generated 1460 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:07:52.275928 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [req-9871966f-b5de-47d7-878c-e7ec640f97c7 req-c52a388a-2142-44f7-add1-5557ace858ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c31c5e-7ef4-4ff9-a333-f27db4050a2e", "name": "network-vif-deleted", "tag": "cbc8a307-df34-44fb-9201-3c417eda1bd8"}]} {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 14:07:52.277470 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 14:07:52.277470 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: warnings.warn(msg) Nov 21 14:07:52.284964 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-9871966f-b5de-47d7-878c-e7ec640f97c7 req-c52a388a-2142-44f7-add1-5557ace858ef service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:52.285410 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [req-9871966f-b5de-47d7-878c-e7ec640f97c7 req-c52a388a-2142-44f7-add1-5557ace858ef service nova] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:52.304060 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.compute.server_external_events [req-9871966f-b5de-47d7-878c-e7ec640f97c7 req-c52a388a-2142-44f7-add1-5557ace858ef service nova] Creating event network-vif-deleted:cbc8a307-df34-44fb-9201-3c417eda1bd8 for instance 98c31c5e-7ef4-4ff9-a333-f27db4050a2e on hv-cinder-76845 Nov 21 14:07:52.308751 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [req-9871966f-b5de-47d7-878c-e7ec640f97c7 req-c52a388a-2142-44f7-add1-5557ace858ef service nova] 10.222.0.11 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036557 Nov 21 14:07:52.309332 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 572/1145] 10.222.0.11 () {64 vars in 1317 bytes} [Sun Nov 21 14:07:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 14:07:52.479021 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-5287124e-877e-444d-a860-0b5215c8937a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:07:52.479658 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-5287124e-877e-444d-a860-0b5215c8937a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 98c31c5e-7ef4-4ff9-a333-f27db4050a2e] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:07:52.487052 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5287124e-877e-444d-a860-0b5215c8937a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:52.487521 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5287124e-877e-444d-a860-0b5215c8937a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:52.488345 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5287124e-877e-444d-a860-0b5215c8937a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:52.488789 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-5287124e-877e-444d-a860-0b5215c8937a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:52.551138 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.policy [None req-5287124e-877e-444d-a860-0b5215c8937a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85790f3393844f68ea138c3b6af8043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122564) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 14:07:52.558594 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-5287124e-877e-444d-a860-0b5215c8937a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e" status: 200 len: 1226 microversion: 2.1 time: 0.083333 Nov 21 14:07:52.559162 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 574/1146] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:07:52 2021] GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 14:07:53.575730 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-7e5d1962-6575-4f0a-97b2-d41994c52fa9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:07:53.576394 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-7e5d1962-6575-4f0a-97b2-d41994c52fa9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 98c31c5e-7ef4-4ff9-a333-f27db4050a2e] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:07:53.582458 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7e5d1962-6575-4f0a-97b2-d41994c52fa9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:53.582906 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7e5d1962-6575-4f0a-97b2-d41994c52fa9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:53.583677 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7e5d1962-6575-4f0a-97b2-d41994c52fa9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:53.584142 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-7e5d1962-6575-4f0a-97b2-d41994c52fa9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:53.596718 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-7e5d1962-6575-4f0a-97b2-d41994c52fa9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] HTTP exception thrown: Instance 98c31c5e-7ef4-4ff9-a333-f27db4050a2e could not be found. Nov 21 14:07:53.597293 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-7e5d1962-6575-4f0a-97b2-d41994c52fa9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Returning 404 to user: Instance 98c31c5e-7ef4-4ff9-a333-f27db4050a2e could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:07:53.598087 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-7e5d1962-6575-4f0a-97b2-d41994c52fa9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e" status: 404 len: 111 microversion: 2.1 time: 0.026906 Nov 21 14:07:53.598597 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 573/1147] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:07:53 2021] GET /compute/v2.1/servers/98c31c5e-7ef4-4ff9-a333-f27db4050a2e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:07:54.043085 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ba7aa37a-024d-4c9e-885b-4b26fd07a045 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:07:54.043595 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.compute.api [None req-ba7aa37a-024d-4c9e-885b-4b26fd07a045 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122564) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:07:54.050601 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ba7aa37a-024d-4c9e-885b-4b26fd07a045 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:54.051053 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ba7aa37a-024d-4c9e-885b-4b26fd07a045 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:54.051865 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ba7aa37a-024d-4c9e-885b-4b26fd07a045 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:54.052312 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG oslo_concurrency.lockutils [None req-ba7aa37a-024d-4c9e-885b-4b26fd07a045 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122564) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:54.065199 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.wsgi [None req-ba7aa37a-024d-4c9e-885b-4b26fd07a045 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] HTTP exception thrown: Instance 9014772b-e240-4c5f-8abc-76aa454938ab could not be found. Nov 21 14:07:54.065796 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-ba7aa37a-024d-4c9e-885b-4b26fd07a045 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Returning 404 to user: Instance 9014772b-e240-4c5f-8abc-76aa454938ab could not be found. {{(pid=122564) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:07:54.066617 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-ba7aa37a-024d-4c9e-885b-4b26fd07a045 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "DELETE /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 404 len: 111 microversion: 2.1 time: 0.028823 Nov 21 14:07:54.067147 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 575/1148] 10.222.0.11 () {58 vars in 1238 bytes} [Sun Nov 21 14:07:54 2021] DELETE /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:07:54.075074 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-bb9b1641-bb9a-416d-9d17-99a1eaf58f94 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '>' {{(pid=122565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:07:54.075685 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.compute.api [None req-bb9b1641-bb9a-416d-9d17-99a1eaf58f94 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] [instance: 9014772b-e240-4c5f-8abc-76aa454938ab] Fetching instance by UUID {{(pid=122565) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 21 14:07:54.082067 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bb9b1641-bb9a-416d-9d17-99a1eaf58f94 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:54.082876 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bb9b1641-bb9a-416d-9d17-99a1eaf58f94 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:54.084241 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bb9b1641-bb9a-416d-9d17-99a1eaf58f94 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 14:07:54.085039 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG oslo_concurrency.lockutils [None req-bb9b1641-bb9a-416d-9d17-99a1eaf58f94 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Lock "da1f9230-ca05-4575-ad3a-5b14aaa593ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 14:07:54.100654 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.wsgi [None req-bb9b1641-bb9a-416d-9d17-99a1eaf58f94 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] HTTP exception thrown: Instance 9014772b-e240-4c5f-8abc-76aa454938ab could not be found. Nov 21 14:07:54.101230 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: DEBUG nova.api.openstack.wsgi [None req-bb9b1641-bb9a-416d-9d17-99a1eaf58f94 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Returning 404 to user: Instance 9014772b-e240-4c5f-8abc-76aa454938ab could not be found. {{(pid=122565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 14:07:54.102037 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO nova.api.openstack.requestlog [None req-bb9b1641-bb9a-416d-9d17-99a1eaf58f94 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab" status: 404 len: 111 microversion: 2.1 time: 0.030708 Nov 21 14:07:54.102553 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: [pid: 122565|app: 0|req: 574/1149] 10.222.0.11 () {58 vars in 1235 bytes} [Sun Nov 21 14:07:54 2021] GET /compute/v2.1/servers/9014772b-e240-4c5f-8abc-76aa454938ab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 14:07:55.372771 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: DEBUG nova.api.openstack.wsgi [None req-0cde3b71-0f37-4de4-8b94-04c8d1806d49 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling method '.version_select at 0x7fd513c1cca0>' {{(pid=122564) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 14:07:55.398659 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO nova.api.openstack.requestlog [None req-0cde3b71-0f37-4de4-8b94-04c8d1806d49 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1360452644" status: 202 len: 0 microversion: 2.1 time: 0.029778 Nov 21 14:07:55.399384 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: [pid: 122564|app: 0|req: 576/1150] 10.222.0.11 () {58 vars in 1262 bytes} [Sun Nov 21 14:07:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1360452644 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 14:08:30.438585 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 14:08:30.439095 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: Sun Nov 21 14:08:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 14:10:17.242964 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 14:10:17.243560 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: Sun Nov 21 14:10:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 14:10:24.462423 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 14:10:24.462880 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: Sun Nov 21 14:10:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 14:10:29.619123 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 14:10:29.619702 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: Sun Nov 21 14:10:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 14:10:33.521052 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 14:10:33.521538 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: Sun Nov 21 14:10:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 14:11:44.836639 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 14:11:44.837244 dv-cinder-768458-12-iscsi devstack@n-api.service[122564]: Sun Nov 21 14:11:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 14:11:50.455286 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 14:11:50.455859 dv-cinder-768458-12-iscsi devstack@n-api.service[122565]: Sun Nov 21 14:11:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!